An Introduction to Stochastic Modeling, Third Edition

Cover......Page 1
Title Page......Page 4
Copyright Page......Page 5
Contents\0......Page 6
Preface\0......Page 10
1. Stochastic Modeling\0......Page 16
2. Probability Review\0......Page 21
3. The Major Discrete Distributions\0......Page 39
4. Important Continuous Distributions\0......Page 48
5. Some Elementary Exercises\0......Page 58
6. Useful Functions, Integrals, and Sums\0......Page 68
1. The Discrete Case\0......Page 72
2. The Dice Game Craps\0......Page 79
3. Random Sums\0......Page 85
4. Conditioning on a Continuous Random Variable\0......Page 94
5. Martingales*\0......Page 102
1. Definitions\0......Page 110
2. Transition Probability Matrices of a Markov Chain\0......Page 115
3. Some Markov Chain Models\0......Page 120
4. First Step Analysis\0......Page 131
5. Some Special Markov Chains\0......Page 150
6. Functionals of Random Walks and Success Runs\0......Page 166
7. Another Look at First Step Analysis*\0......Page 184
8. Branching Processes*\0......Page 192
9. Branching Processes and Generating Functions*\0......Page 199
1. Regular Transition Probability Matrices\0......Page 214
2. Examples\0......Page 230
3. The Classification of States\0......Page 249
4. The Basic Limit Theorem of Markov Chains\0......Page 260
5. Reducible Markov Chains*\0......Page 273
1. The Poisson Distribution and the Poisson Process\0......Page 282
2. The Law of Rare Events\0......Page 294
3. Distributions Associated with the Poisson Process\0......Page 305
4. The Uniform Distribution and Poisson Processes\0......Page 312
5. Spatial Poisson Processes\0......Page 326
6. Compound and Marked Poisson Processes\0......Page 333
1. Pure Birth Processes\0......Page 348
2. Pure Death Processes\0......Page 360
3. Birth and Death Processes\0......Page 370
4. The Limiting Behavior of Birth and Death Processes\0......Page 381
5. Birth and Death Processes with Absorbing States\0......Page 394
6. Finite State Continuous Time Markov Chains\0......Page 409
7. A Poisson Process with a Markov Intensity*\0......Page 423
1. Definition of a Renewal Process and Related Concepts\0......Page 434
2. Some Examples of Renewal Processes\0......Page 441
3. The Poisson Process Viewed as a Renewal Process\0......Page 447
4. The Asymptotic Behavior of Renewal Processes\0......Page 452
5. Generalizations and Variations on Renewal Processes\0......Page 462
6. Discrete Renewal Theory*\0......Page 472
1. Brownian Motion and Gaussian Processes\0......Page 488
2. The Maximum Variable and the Reflection Principle\0......Page 506
3. Variations and Extensions\0......Page 513
4. Brownian Motion with Drift\0......Page 523
5. The Ornstein-Uhlenbeck Process*\0......Page 539
1. Queueing Processes\0......Page 556
2. Poisson Arrivals, Exponential Service Times\0......Page 562
3. General Service Time Distributions\0......Page 573
4. Variations and Extensions\0......Page 582
5. Open Acyclic Queueing Networks\0......Page 596
6. General Open Networks\0......Page 607
Further Reading\0......Page 616
Answers to Exercises\0......Page 618
Index\0......Page 640