Fundamentals of Performance Evaluation of Computer and Telecommunications Systems

FUNDAMENTALS OF PERFORMANCE EVALUATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS......Page 4
CONTENTS......Page 10
PREFACE......Page 16
1 INTRODUCTION AND BASIC CONCEPTS......Page 20
1.1 Background......Page 21
1.2 Performance Evaluation Viewpoints and Concepts......Page 22
1.3 Goals of Performance Evaluation......Page 24
1.4 Applications of Performance Evaluation......Page 25
1.5 Techniques......Page 26
1.6 Metrics of Performance......Page 27
1.7 Workload Characterization and Benchmarking......Page 29
1.8 Summary......Page 37
References......Page 38
Exercises......Page 39
2 PROBABILITY THEORY REVIEW......Page 40
2.1 Basic Concepts on Probability Theory......Page 41
2.2 Elementary Sampling......Page 45
2.3 Random Variables......Page 48
2.4 Sums of Variables......Page 57
2.5 Regression Models......Page 59
2.6 Important Density and Distribution Functions......Page 66
2.7 Markov Processes......Page 69
2.8 Limits......Page 73
2.9 Comparing Systems using Sample Data......Page 76
References......Page 81
Exercises......Page 82
3.1 Measurement Strategies......Page 85
3.2 Event Tracing......Page 86
3.3 Monitors......Page 89
3.4 Program Optimizers......Page 92
3.5 Accounting Logs......Page 93
References......Page 94
Exercises......Page 95
4 BENCHMARKING AND CAPACITY PLANNING......Page 97
4.1 Introduction......Page 98
4.2 Types of Benchmark Programs......Page 99
4.3 Benchmark Examples......Page 102
4.4 Frequent Mistakes and Games in Benchmarking......Page 115
4.5 Procedures of Capacity Planning and Related Main Problems......Page 119
4.6 Capacity Planning for Web Services......Page 121
4.7 Summary......Page 127
References......Page 128
Exercises......Page 131
5 DATA REPRESENTATION AND ADVANCED TOPICS ON VALIDATION MODELING......Page 132
5.1 Data Representation......Page 133
5.2 Measurements......Page 137
5.3 Program Profiling and Outlining......Page 142
5.4 State Machine Models......Page 146
5.5 Petri Net-Based Modeling......Page 154
5.6 Protocol Validation......Page 162
References......Page 166
Exercises......Page 167
6.1 Queue Models......Page 171
6.2 Queue Parameters......Page 176
6.3 Little’s Law......Page 181
6.4 Priority Management......Page 186
6.5 Analysis of M/M/1 Systems......Page 189
6.6 The M/M/M Queue......Page 195
6.7 Other Queues......Page 196
6.8 Queueing Models with Insensitive Length Distribution......Page 203
References......Page 205
Exercises......Page 206
7.1 Fundamentals of Queueing Networks......Page 209
7.2 Model Inputs and Outputs in Queueing Networks......Page 214
7.3 Open Networks......Page 217
7.4 Closed Queueing Networks......Page 223
7.5 Product Form Networks......Page 228
7.6 Mean Value Analysis......Page 234
7.7 Analysis Using Flow Equivalent Servers......Page 237
References......Page 239
Exercises......Page 240
8.1 Operational Laws......Page 245
8.2 Little’s Formula......Page 250
8.3 Bottleneck Analysis......Page 255
8.4 Standard MVA......Page 258
8.5 Approximation of MVA......Page 263
8.6 Bounding Analysis......Page 267
8.7 Case Study: A Circuit Switching System......Page 274
References......Page 278
Exercises......Page 279
9 INTRODUCTION TO SIMULATION TECHNIQUE......Page 284
9.1 Introduction......Page 285
9.2 Types of Simulation......Page 294
9.3 Some Terminology......Page 298
9.4 Random-Number-Generation Techniques......Page 299
9.5 Survey of Commonly Used Random Number Generators......Page 310
9.6 Seed Selection......Page 311
9.7 Random Variate Generation......Page 313
9.8 Testing of Random Number Sequences......Page 318
9.9 Summary......Page 326
References......Page 327
Exercises......Page 329
10 COMMONLY USED DISTRIBUTIONS IN SIMULATION AND THEIR APPLICATIONS......Page 331
10.1 Exponential Distribution......Page 332
10.2 Poisson Distribution......Page 334
10.3 Uniform Distribution......Page 337
10.4 Normal Distribution......Page 338
10.5 Weibull Distribution......Page 345
10.6 Pareto Distribution......Page 346
10.7 Geometric Distribution......Page 349
10.8 Gamma distribution......Page 350
10.9 Erlang Distribution......Page 353
10.10 Beta Distribution......Page 356
10.11 Binomial Distribution......Page 358
10.12 Chi-Square Distribution......Page 361
10.13 Student’s t Distribution......Page 364
10.14 Examples of Applications......Page 365
References......Page 368
Exercises......Page 369
11.1 Introduction......Page 372
11.2 Fundamental Approaches......Page 374
11.3 Verification Techniques......Page 377
11.4 Validation Techniques......Page 381
11.5 Verification and Validation in Distributed Environments......Page 384
11.6 Transient Elimination......Page 388
11.7 Stopping Principles for Simulations......Page 391
11.8 Accreditation......Page 392
References......Page 393
Exercises......Page 394
12 SIMULATION SOFTWARE AND CASE STUDIES......Page 396
12.2 Selection of Simulation Software......Page 397
12.3 General-Purpose Programming Languages......Page 398
12.4 Simulation Languages......Page 400
12.5 Simulation Software Packages......Page 417
12.6 Comparing Simulation Tools and Languages......Page 436
12.7 Case Studies on Simulation of Computer and Telecommunication Systems......Page 437
12.8 Summary......Page 447
References......Page 449
Exercises......Page 451
APPENDIX A TABLE OF STANDARD NORMAL (Z) DISTRIBUTION......Page 453
APPENDIX B COMMONLY USED NORMAL QUANTILES......Page 455
APPENDIX C QUANTILES OF UNIT NORMAL DISTRIBUTION......Page 456
APPENDIX D QUANTILES OF STUDENT’S T-DISTRIBUTION WITH V DEGREES OF FREEDOM......Page 458
INDEX......Page 460