Frontiers of Test Validity Theory: Measurement, Causation, and Meaning

Cover
Half Title
Series Page
Title Page
Copyright Page
Dedication
Contents
2013 Preface
2024 Preface
Foreword By Series Editor Lisa L. Harlow
Acknowledgments
1. Introduction: Surveying the Field of Test Validity Theory
	Terminology
		Testing, Assessing, and Measuring
		Attributes, Constructs, and Latent Variables
		Items, Indicators, and Indices
		Test Validity and Validation
	The Development of Test Validity Theory
		Descriptive Empiricism
		Explanatory Empiricism
		Constructivist Realism
		Pragmatism
		Consequentialism
	Measurement, Causation, Meaning, and Test Validity
		Measurement and Test Validity
		Causation and Test Validity
		Meaning and Test Validity
		Further Reading
PART I: Measurement
	2. Philosophical Theories of Measurement
		The Classical Theory of Measurement
		Addition and Concatenation
		The Representational Theory of Measurement: Stevens’ Version
		The Representational Theory of Measurement: The Axiomatic Approach
		The Latent Variable Perspective
		Chapter Conclusion
			Further Reading
	3. Psychometric Models
		Psychometric Models
			Classical Test Theory
			Generalizability Theory
			Modern Test Theory and the Latent Variable Model
		Test Scores, Constructs, and Validity
			Validity as a Relation Between Test Scores and True Scores
			Validity as a Relation Between Test Scores and External Variables
			Validity as a Relation Between Test Scores and Universe Scores
			Validity as a Causal Relation Between Test Scores and Latent Variables
		The Relation Between Validity and Other Psychometric Concepts
			Reliability and Validity
			Measurement Invariance, Predictive Invariance, and Validity
			Psychometrics and Validity
		Chapter Conclusion
			Further Reading
	4. Open Issues in Measurement Theory and Psychometrics
		Measurement and the Structure of Psychological Attributes
		Measurement and Probabilistic Models
		A Possible Reconciliation Between Theories of Measurement
		Is Measurement Necessary in Psychological Testing?
		Chapter Conclusion
			Further Reading
PART II: Causation
	5. Test Scores as Samples: Behavior Domain Theory
		Conceptualizing Domain Scores
		The Item Writing Argument for Behavior Domain Theory
		The Distinctness Argument Against Domain Score Causation
		Reconciling Behavior Domains and Causal Theories of Measurement
			Causal Homogeneity as a Basis for BDT
			Causal Homogeneity as a Contingent Fact
			BDT Without a Causal Basis
		Chapter Conclusion
			Further Reading
	6. Causality in Measurement
		Causal Structures
			The Reflective Model
			The Formative Model
		Implications for Validity Theory
		Direct, Indirect, and Mixed Models
		Other Structures
			Reactive Indicators
			Bonds and Watersheds
			Networks
		Chapter Conclusion
			Further Reading
	7. Causation, Correlation, and Reflective Measurement Models
		Reflective Measurement With and Without Causation
			Uses of Non-causal Interpretations
			General Causal Interpretation of a Reflective Measurement Model
		Statistical Unidimensionality Versus Causal Unidimensionality
		Four General Theories of Causation
			Regularity Theories of Causation
			Counterfactual Theories of Causation
			Mechanism Theories of Causation
			Causal Power Theories of Causation
		Reflective Measurement Models with Different Causal Interpretations
			Regularity Theories and Reflective Measurement Models
			Counterfactual Theories and Reflective Measurement Models
			Mechanism Theories and Reflective Measurement Models
			Causal Power Theories and Reflective Measurement Models
		Reflective Measurement, Causation, and Validation
		Chapter Conclusion
			Further Reading
	8. Problems in Causation and Validity: Formative Measurement, Networks, and Individual Differences
		Formative Measurement Models and Causation
			Regularity Theories and Formative Models
			Counterfactual Theories and Formative Models
			Mechanism Theories and Formative Models
			Causal Power Theories and Formative Models
			Formative Model Summary
		Network Measurement Models
		Causation and Individual Differences
			Regularity Approaches to Inter-individual Causation
			Counterfactual Approaches to Inter-individual Causation
			Mechanism Approaches to Inter-individual Causation
			Causal Power Approaches to Inter-individual Causation
			Causation and Individual Differences Conclusion
		Validating Causal Measurement Models
			Further Reading
PART III: Meaning
	9. Interpreting Test Responses: Validity, Values, and Evaluation
		Messick’s Unified View of Validity
		Historical Context and Recent Literature
		Shadish, Cook, and Campbell’s Critique
		Scriven’s Critique
		Searl’s Naturalistic-Fallacy Fallacy
		Putnam’s Critique of the Fact/Value Dichotomy
		Conceptualizations of Test Validity and Their Implications
		Chapter Conclusion
			Further Reading
	10. A Model of Test Score Interpretation
		Focal Example: Tuna Cleaner Work Sample
		Interpretation and Entailment: Construct Theories as Inference Engines
		Interpretations of Test Scores
			Claim 1: Test Scores as Values
			Claim 2: Test Scores Interpreted
			Claim 3: Modeling Interpretations as Premises
			Claim 4: Differences in Interpretation
			Claim 5: Guiding Validation Research
			Claim 6: The Goldilocks Criterion for Good Interpretations
		Chapter Conclusion
			Further Reading
	11. Open Questions About Test Score Meaning
		The Psychologist’s Fallacy and Test Score Interpretation
		Meaning’s in the Heads of Test Takers?
		Heteroglossia: Speaking in Diverse Tongues
		Test Takers and Their Beliefs
		Validity Without Determinate Meaning
		Chapter Conclusion
			Further Reading
PART IV: Conclusion
	12. An Integrative View of Test Validity
		An Integrative Model of Test Validation
		Truth, Justification, Knowledge, and Action
		Kinds of Causality and Types of Evidence
			No Causation
			Regularity Causation
			Counterfactual Causation
			Mechanism Causation
			Causal Power Causation
		Justification Through Alignment
		Toward a Grammar of Validity Arguments
		Knowledge, Value, and Action
		Chapter Conclusion
			Further Reading
	13. Epilogue as Dialog: The Future of Test Validity Theory
		Test Validation Methods
		Test Validity Theory and Meaning
		The Yardstick by Which Validation Is Judged (If There Is One)
		Validity and Response Processes
		Attributes
		Tests and Interpretations
		Progress of Test Validity Theory as a Discipline
		Unity Versus Disunity in Test Validity Theory
		The Shift Toward Consequentialism
		Theory and Observation
		Chapter Conclusion
References
Name Index
Subject Index
Example Index