Language Testing and Validation: An Evidence-Based Approach

Cover......Page 1
Contents......Page 8
General Editors\' Preface......Page 11
Acknowledgements......Page 12
Abbreviations......Page 13
Introduction......Page 16
Part 1 Testing as Validity......Page 18
1.1 The Cambridge Proficiency Examination 1913–1945: \'The Garden of Eden\', \'the pre-scientific era\'......Page 20
1.2 Developments in the 1960s: the move towards a language-based examination......Page 22
1.3 The 1975 and 1984 revisions: \'The Promised Land\'?......Page 23
2 The Nature of Test Validity......Page 26
3.1 Theory-based validity......Page 32
3.2 Context validity......Page 34
4.1 Scoring validity......Page 37
4.2 Criterion-related validity......Page 50
4.3 Consequential validity......Page 52
Part 2 New Frameworks for Developing and Validating Tests of Reading, Listening, Speaking and Writing......Page 56
Introduction......Page 58
5 Test Takers......Page 66
5.1 Physical/physiological characteristics: making accommodations......Page 67
5.2 Psychological characteristics: affective schemata......Page 68
5.3 Experiential characteristics: familiarity......Page 69
6 Context Validity in Action......Page 71
6.1 Task setting......Page 72
6.2 Task demands......Page 83
6.3 Setting and test administration......Page 97
7 Theory-based Validity in Action......Page 100
7.1 Reading......Page 102
7.2 Listening......Page 110
7.3 Speaking......Page 117
7.4 Writing......Page 123
8.1 Techniques for testing reading comprehension......Page 134
8.2 Techniques for testing listening comprehension......Page 147
8.3 Techniques for testing speaking......Page 158
8.4 Techniques for testing written production......Page 176
9 Scoring Validity in Action......Page 192
9.1 Scoring written production......Page 194
9.2 Scoring speaking tests......Page 206
9.3 Internal reliability of receptive tests......Page 216
9.4 Scores, grading and post-exam validation procedures......Page 220
10.1 Criterion-related validity......Page 222
10.2 Consequential validity......Page 225
Part 3 Generating Validity Evidence......Page 232
Introduction......Page 234
11.1 An introductory note on research......Page 236
11.2 A priori validation: investigating the specification of the construct and the operationalization of the test......Page 237
11.3 Establishing context validity......Page 239
11.4 Establishing theory-based validity evidence......Page 248
11.5 Establishing scoring validity evidence......Page 262
11.6 Establishing evidence on a posteriori validities......Page 274
Part 4 Further Resources in Language Testing......Page 286
12.1 Books......Page 288
12.2 Journals......Page 289
12.4 Principal testing conferences......Page 291
12.6 Internet sites......Page 292
12.8 Statistical packages......Page 295
Postscript......Page 298
References......Page 300
P......Page 314
V......Page 315