Testing IT: An Off-the-Shelf Software Testing Process

Cover......Page 1
Half-title......Page 3
Title......Page 5
Copyright......Page 6
Dedication......Page 7
Contents......Page 9
Foreword......Page 15
Acknowledgments......Page 17
1.1 Purpose of the Book......Page 21
1.3 How to Read This Book......Page 22
1.4 Structure and Content of This Book......Page 23
Part 1 The Traditional Testing Process......Page 25
2.2 The Challenge of Testing......Page 27
2.3 What Is Testing?......Page 28
2.4 Verification and Validation......Page 30
2.6 Testing – The Bottom Line......Page 31
2.7 Additional Information......Page 32
3.1 Introduction......Page 35
3.2.1 Positive and Negative Testing......Page 36
3.2.3 Error Guessing......Page 37
3.2.4 Automated Software Testing......Page 38
3.3.1 Equivalence Partitioning......Page 39
3.3.3 Intrusive Testing......Page 40
3.3.5 State Transition Analysis......Page 41
3.4.1 Configuration/Installation Testing......Page 42
3.4.5 Performance Testing......Page 43
3.4.7 Security Testing......Page 44
3.4.9 Usability Testing......Page 45
3.5 Further Reading on Testing Techniques......Page 46
4.1 Introduction......Page 47
4.2 The Organization of Testing......Page 48
4.3.1 Overview......Page 49
4.3.3 Test Team Leader......Page 50
4.3.4 Test Analyst......Page 51
4.3.6 Independent Test Observer......Page 52
Test Automation Analyst......Page 53
4.4.1 Overview......Page 54
4.4.3 Integration Testing......Page 55
4.4.4 System Testing......Page 56
4.4.5 Systems Integration Testing......Page 57
4.4.7 Regression Testing......Page 58
4.5 Role of the V Model in Planning......Page 59
4.6 The Management of Test Requirements......Page 61
4.8 The Role and Use of Defect Tracking......Page 62
4.9 The Role of Risk in Test Planning and Management......Page 63
5.1 Overview......Page 65
5.3 Unit Test Data Requirements......Page 67
5.4 Roles and Responsibilities......Page 68
5.5 Planning and Resources......Page 69
5.8 Outputs......Page 70
6.1 Overview......Page 73
6.2 Integration Test Approach......Page 74
6.4 Roles and Responsibilities......Page 75
6.5 Planning and Resources......Page 76
6.8 Outputs......Page 77
7.1.Overview......Page 79
7.3.System Test Data Requirements......Page 80
7.4.Roles and Responsibilities......Page 81
7.5 Planning and Resources......Page 82
7.8 Outputs......Page 83
8.1 Overview......Page 85
8.2 Systems Integration Test Approach......Page 86
8.4 Roles and Responsibilities......Page 87
8.5 Planning and Resources......Page 88
8.7 Testing Techniques for Systems Integration Testing......Page 89
8.8 Outputs......Page 90
9.1 Overview......Page 93
9.2 User Acceptance Test Approach......Page 94
9.4 Roles and Responsibilities......Page 95
9.5 Planning and Resources......Page 96
9.6 Inputs......Page 97
9.8 Outputs......Page 98
10.1 Overview......Page 101
10.2 Operations Acceptance Test Approach......Page 102
10.3 Operations Acceptance Test Data Requirements......Page 103
10.4 Roles and Responsibilities......Page 104
10.5 Planning and Resources......Page 105
10.8 Outputs......Page 106
11.1 Overview......Page 109
11.2 Regression Test Approach......Page 110
11.3 Regression Test Data Requirements......Page 111
11.4 Roles and Responsibilities......Page 112
11.5 Planning and Resources......Page 113
11.8 Outputs......Page 114
12.1 Introduction......Page 117
12.2 Overview of the Role and Use of Metrics......Page 118
12.3 Metrics Typically Used within the Testing Process......Page 119
12.4 Setting Up and Administering a Metrics Program......Page 122
12.5 A Proposal for a Simple and Effective Metrics Set......Page 124
12.6 Further Reading......Page 126
13.2.1 Overview......Page 127
13.2.2 Establishing the Requirement......Page 128
13.2.3 Strategy for Introduction and Adoption......Page 129
13.3 Maintenance of the Testing Process......Page 131
Part 2 The Testing Process in the Real World: Illustrative Case Studies......Page 133
British Library......Page 135
Reuters Product Acceptance Group......Page 136
Crown Quality Assurance Group......Page 137
The Wine Society......Page 138
Automatic Data Processing Limited......Page 139
14.2 Characteristics of the Testing Requirement......Page 141
14.3 The Management and Planning of Testing......Page 142
Testing Manager......Page 144
Test Analyst......Page 145
Independent Test Observer......Page 146
14.6 Artifacts......Page 147
14.7 Process Improvement......Page 148
15.1 Overview of the Organization......Page 149
15.2 Testing Requirements......Page 150
15.3 The Management and Planning of Testing......Page 152
15.4 Roles and Responsibilities......Page 153
RDB/GUI Acceptance Managers......Page 154
Test Analyst......Page 155
15.5 Testing Phases......Page 156
Unit, Link, Systems, and Integration Testing......Page 157
Acceptance Testing......Page 158
User Testing......Page 159
15.6 Artifacts......Page 160
15.7 Process Improvement......Page 161
16.1 Overview of the Organization......Page 163
16.2 Testing Requirements......Page 164
16.3 The Management and Planning of Testing......Page 165
QA Team Manager......Page 167
Test Analyst/Tester......Page 168
Client Representative......Page 169
System Testing......Page 170
Acceptance Testing......Page 171
16.6 Artifacts......Page 172
16.7 Process Improvement......Page 173
17.1 Overview of the Organization......Page 175
17.2 Testing Requirements......Page 176
17.3 The Management and Planning of Testing......Page 177
Project Manager......Page 179
Testing Consultant......Page 180
17.5 Testing Phases......Page 181
Regression Testing......Page 182
17.6 Artifacts......Page 183
17.7 Process Improvement......Page 184
18.1 Overview of the Organization......Page 187
18.2 Characteristics of the Testing Requirement......Page 188
18.3 The Management and Planning of Testing......Page 189
18.4 Roles and Responsibilities......Page 191
Development Project Manager......Page 192
QA Analyst......Page 193
18.5 Testing Phases......Page 194
Acceptance Testing......Page 195
Regression Testing......Page 196
18.6 Artifacts......Page 198
18.7 Process Improvement......Page 199
Part 3 The Appendices......Page 201
A.1 Introduction......Page 203
Reporting and Liaison......Page 204
References......Page 205
Reporting and Liaison......Page 206
References......Page 207
Reporting and Liaison......Page 208
Reference......Page 209
Reporting and Liaison......Page 210
Reference......Page 211
Reporting and Liaison......Page 212
References......Page 213
Reporting and Liaison......Page 214
Reference......Page 215
B.1 Introduction......Page 217
Outputs......Page 218
References......Page 219
Outputs......Page 220
References......Page 221
Outputs......Page 222
References......Page 223
Outputs......Page 224
References......Page 225
Outputs......Page 226
References......Page 227
Outputs......Page 228
References......Page 229
C.1 Introduction......Page 231
D.1 Introduction......Page 241
E.1 Introduction......Page 251
F.1 Introduction......Page 257
G.1 Introduction......Page 261
H.1 Introduction......Page 265
I.2 Creating a Re-use Pack......Page 267
I.4 How to Use the Re-use Pack......Page 268
J.1 Introduction......Page 269
K.3 Analyzing the Testing Requirements......Page 275
K.4 Designing the Test Cases......Page 276
L.3 Analyzing the Testing Requirements......Page 277
L.4 Designing the Test Cases......Page 278
M.4 Designing the Test Cases......Page 279
N.2 Scoring Scheme......Page 281
N.4 Support for Testing Management......Page 282
N.5 Tool Technical Issues......Page 283
N.7 Tool Documentation Issues......Page 284
N.8 Tool Integration Issues......Page 285
N.9 Tool Usability Issues......Page 286
N.10 Supplier Issues......Page 287
N.11 Training and Consultancy Issues......Page 288
N.13 Miscellaneous Issues......Page 289
O.2 Roles and Responsibilities......Page 295
O.5 Post-Test Activities......Page 296
P.2 Terminology......Page 299
P.4 Testing Process......Page 300
P.5 Roles and Responsibilities......Page 301
P.6 Testing Phases......Page 302
P.7 Optional Evaluation Scheme......Page 303
Q.2 Object-Oriented Development......Page 307
Iterative Development......Page 309
Rapid Prototyping......Page 310
Q.4 Impact of OO on Test Design......Page 311
Integration Testing......Page 312
Acceptance Testing......Page 313
References......Page 315
Introduction......Page 317
Index......Page 331