The Social Validity Manual: Subjective Evaluation of Interventions

Cover
The Social Validity Manual: Subjective Evaluation of Interventions
Copyright
Dedication
List of figures
List of tables
Preface
1 Background of social validity
	Defining social validity
		What is social validity?
		Development of a concept
	Dimensions of applied behavior analysis
		Criteria I: Applied
		Criteria II: Behavioral
		Criteria III: Analytic
		Criteria IV: Technological
		Criteria V: Conceptually systematic
		Criteria VI: Effective
		Criteria VII: Generality
		Importance of social validity
			Is social validity important?
				Example of the need for social validity assessment
		Purpose of social validity
			What is the purpose of social validity?
	Positive behavior interventions and supports
		Origin of positive behavior interventions and supports movement: ABA
		Origin of positive behavior interventions and supports movement: normalization/inclusion
		Origin of positive behavior interventions and supports movement: person-centered values
	Positive behavior interventions and supports criteria
		Positive behavior interventions and supports Criteria I: Comprehensive lifestyle change and quality of life
		Positive behavior interventions and supports Criteria II: Life-span development
		Positive behavior interventions and supports Criteria III: Ecological validity
		Positive behavior interventions and supports Criteria IV: Stakeholder development
		Positive behavior interventions and supports Criteria V: Social validity
		Positive behavior interventions and supports Criteria VI: Systems change and multicomponent interventions
		Positive behavior interventions and supports Criteria VII: Emphasis on prevention
		Positive behavior interventions and supports Criteria VIII: Flexibility with respect to scientific practices
		Positive behavior interventions and supports Criteria IX: Multiple theoretical perspectives
2 Conceptualizations of social validity
	Dimensions of social validity
	Habilitative validity
	Working model of treatment acceptability
	Decision-making model of treatment acceptability
	Expansive view of treatment acceptability
	Epidemiological conceptualization of social validity
	Assessment model of social validity
	Maintenance model of social validity
	Distributive model of treatment acceptability
3 Instruments and methods for evaluating social validity
	Methods for measuring social validity
		Interviews
		Direct observation
		Performance criteria
	Formal treatment acceptability measurement instruments
		Treatment Evaluation Inventory
		Treatment Evaluation Inventory-Short Form
		Treatment Acceptability Rating Form
		Treatment Acceptability Rating Form-Revised
		School Intervention Rating Form
		Intervention Rating Profile
		Intervention Rating Profile-15
		Children’s Intervention Rating Profile
		Kids Intervention Profile
		Behavior Intervention Rating Scale
		Scale of Treatment Perceptions
		Intervention-Process Rating Scale
		Abbreviated Acceptability Rating Profile
		Treatment Acceptability/Adherence Scale
		Implicit Relational Assessment Procedure
	Comparison of treatment acceptability measures
	Problems related to social validity measurement
	Methods for increasing the use of treatment acceptability instruments
		Increase availability of instruments and other measures
		Increase consultant awareness of instruments
		Increase competency in the administration and scoring of instruments
		Increase knowledge of potential uses of acceptability information
		Reemphasize the importance of social validity
4 Research on social validity
	Early protocols for measuring social validity
	Methodological variations
	Literature reviews of treatment acceptability
	Research findings
	Treatment Evaluation Inventory and Treatment Evaluation Inventory-Short Form
		Treatment variables
		Previous treatment information
		Client variables
		Rater variables
	Intervention Rating Profile and Intervention Rating Profile-15
		Treatment variables
		Consumer variable manipulation
		Rater variable manipulation
		Raters’ knowledge of treatment
		Diagnostic label of the client
	Teacher acceptability measure
	Children’s Intervention Rating Profile
	Behavior Intervention Rating Scale
	Abbreviated Acceptability Rating Profile
		Age/gender of client
	Treatment Acceptability Rating Form-Revised
	Contradictory findings
5 Increasing the social significance of treatment goals
	Consumer significance
		Personal preferences/values
			Choice
			Habilitative potential
			Awareness of coercion
			Immediate versus long-term benefits
	Consultant
		Training
		Personal/professional agenda
		Goals
			Clarity and specific outcome criteria of goals
			Complexity and comprehensiveness of goals
			Potential for actualizing the goal
		Instrument/method
			Validity and reliability
			Ease of implementation
			Specificity to target individual/group
			Clarity of items
	Societal significance
		Normalization
		Use of available resources and funding
	Strategies to boost the social validity of treatment goals
		Step 1—Incorporate semistructured interviews
		Step 2—Gather information from multiple sources
		Step 3—Considering different aspects of the individual’s life
		Step 4—Rank treatment goals hierarchically
		Step 5—Operationalize the expected outcomes in both clinical and social(lay) terminology
6 Enhancing the appropriateness of treatment procedures
	Preliminary factors to consider when planning for social validity
		Determine how the information will be used
		Consider the reliability and validity of measures
	Consumer acceptability
		Characteristics of consumers
		Knowledge of treatment
	Consultant acceptability
		Characteristics of consultant
		Affiliations of consultant
		Familiarity with recent advances in the field
		Interaction style of consultant
		Assessment methods
		Design of treatment
			Treatment intrusiveness
			Implementation difficulty
			Other variables
	Societal appropriateness
	Strategies to improve the social validity of procedures and programs
		Step 1—Explain to consumers why information is being collected and how it will be used
		Step 2—Look for problems first
		Step 3—Determine how social validity should be measured
		Step 4—Determine when social validity of procedures should be measured (pre- or posttreatment)
		Step 5—Determine who should rate the acceptability of the procedures
		Step 6—Determine the conditions under which ratings should be obtained
		Step 7—Determine what type of training should be provided to raters
		Step 8—Allow time for behaviors to become established
7 Improving the importance of treatment effects
	Core Concept 1: antidiscrimination
	Core Concept 2: individualized and appropriate services
	Core Concept 3: classification
	Core Concept 4: capacity-based services
	Core Concept 5: empowerment/participatory decision making
	Core Concept 6: service coordination and collaboration
	Core Concept 7: protection from harm
	Core Concept 8: liberty
	Core Concept 9: autonomy
	Core Concept 10: privacy and confidentiality
	Core Concept 11: integration
	Core Concept 12: productivity and contribution
	Core Concept 13: family integrity and unity
	Core Concept 14: family centeredness: services to the whole family
	Core Concept 15: cultural responsiveness
	Core Concept 16: accountability
	Core Concept 17: professional and system capacity building
	Core Concept 18: prevention and amelioration
	Consumer importance
	Consumer understanding of treatment effects
	Quality of life
	Consultant importance
		Evaluating data
		Significant change in behavior
		Maintenance of treatment effects
		Normative comparison
	Societal importance
		Community expert evaluation
		Cost analysis
		Conformity to local/national norms
	Strategies for attaining social importance for the effects of treatment
		Ensure consumers have a clear understanding of treatment effects
		Provide normative comparisons
		Collect data on associated variables
		Conducting cost analyses
		Identify experts to evaluate the effects
8 Social validity and ethics
	Social validity within ethical guidelines
	Aversive procedures and social validity
	How social validity can support ethical guidelines
		Competence
		Professional and scientific responsibility
		Respect for people’s rights and dignity
		Welfare of others
		Contribution to society and others
9 Social validity and cultural competence
	Cultural competence
		Assessing cultural preferences and norms
		Incorporating cultural awareness into professional development and practice
		Cultural awareness and behavior analysis
		Cultural responsiveness in education
	Recommendations for increasing cultural competence in professionals
10 Social validity in health sciences
	Research within specific health sciences fields
		Nursing
		Pediatrics
		Speech/language
		Psychotherapy
		Dentistry
	Outlining systemic practice for incorporating social validity into health sciences
		Surveys
		Rating scales
		Semistructured interviews
		Focus groups
		Patient advisory groups
11 Organization of social validity data
	Microlevel organization of data
	Medial level organization of data
	Macrolevel organization of data
		Validity of data
		Examination of validity
		Content relevance and representativeness
		Substantive theories, process models, and process engagement
		Scoring models as reflective of task and domain structure
		Generalizability and the boundaries of score meaning
		Convergent and discriminant correlations with external variables
		Consequences as validity evidence
12 The future of social validity
	Additional factors to consider when planning for social validity
		Sampling size
		Accuracy of assessments
		Normative data
		Obtrusiveness of assessment
		Measuring correlated behaviors
		Offering choices
	Future social validity research
		Surveys
		Verbal reports/interviews
		Concurrent-chains for participant selection
		Peer comparison
		Formal instruments
		New procedures
References
	Further reading
Index
Back Cover