Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning.
1995/09/01 by Samuel Messick · 69 citations
Decision Sciences · Psychology · #Psychometric Methodologies and Testing #Motivation and Self-Concept in Sports #Psychological Testing and Assessment
paper · doi:10.1037/0003-066x.50.9.741
Abstract
The traditional conception of validity divides it into three separate and substitutable types—namely, content, criterion, and construct validities. This view is fragmented and incomplete, especially because it fails to take into account both evidence of the value implications of score meaning as a basis for action and the social consequences of score use. The new unified concept of validity interrelates these issues as fundamental aspects of a more comprehensive theory of construct validity that addresses both score meaning and social values in test interpretation and test use. That is, unified validity integrates considerations of content, criteria, and consequences into a construct framework for the empirical testing of rational hypotheses about score meaning and theoretically relevant relationships, including those of an applied and a scientific nature. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of validity as a unified concept. These are content, substantive, structural, generalizability, external, and consequential aspects of construct validity. In effect, these six aspects function as general validity criteria or standards for all educational and psychological measurement, including performance assessments, which are discussed in some detail because of their increasing emphasis in educational and employment settings.
Cited by
- Measuring Learning Outcomes in Higher Education
- Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles
- Validating the Instruments to Measure ESL / EFL Learners' Self‐Efficacy Beliefs and Self‐Regulated Learning Strategies
- The Development of Epistemological Theories: Beliefs About Knowledge and Knowing and Their Relation to Learning
- Cognitive Processing of Self-Report Items in Educational Research: Do They Think What We Mean?
- Using small data to interpret big data: 311 reports as individual contributions to informal social control in urban neighborhoods
- The Hidden Measurement Crisis in Criminology
- Availability of cookies during an academic course session affects evaluation of teaching
- The Eyberg Child Behavior Inventory: Factorial invariance in problem behaviors across gender and age
- A validated toolkit for access and participation evaluation (TAPE)
- The Geographic Distribution of Big Five Personality Traits
- The development and validation of an L2 student digital multimodal composing competence scale
- Developing and Validating a Diagnostic Checklist to Assess Argumentation in EFL Writing
- Looking for Renaissance People: Examining Domain Specificity-Generality of Creativity Using Item Response Theory Models
- Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments
- A dialectic on validity: Explanation-focused and the many ways of being human
- Exploring Validity Evidence for Mathematics Self-Concept of Adolescents: Key Findings from PISA 2022
- Measuring the effects of Crime Prevention Through Environmental Design (CPTED) on fear of crime in public spaces
- Social media emotions annotation guide (SMEmo): Development and initial validity
- A Typology of Mixed Methods Sampling Designs in Social Science Research
- Aligning Patient Discharge Curricula to Patient-Reported Outcomes in Sub Internship
- Measuring what learners do in feedback: the feedback literacy behaviour scale
- The Survey Checklist (Manifesto)
- Development and Initial Validation of the Shame Frequency Questionnaire in Medical Students
- The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes
- Psychology's Questionable Research Fundamentals (QRFs): Key problems in quantitative psychology and psychological measurement beyond Questionable Research Practices (QRPs)
- Unpacking the digital literacy–self-regulated learning nexus: A systematic review and a three-level meta-analysis
- A meta-analytic review of authentic and transformational leadership: A test for redundancy
- Conceptual Complexity and Construct Validity
- Quantitative Research On the Primary Process: Method and Findings
- When Can AI Models Explain Learning? Validity Criteria for AI as Cognitive Models in Education
- Psychometrically derived 60-question benchmarks: Substantial efficiencies and the possibility of human-AI comparisons
- Understanding Implicit Bias: Putting the Criticism into Perspective
- The Meaning of Validity in the New Standards for Educational and Psychological Testing:
- The Implicit Association Test: A Method in Search of a Construct
- Construct Meaning in Multilevel Settings
- Developing an objective measure of knowledge of factory farming
- A qualitative study of validation practices in classroom-based assessment in health professions education: what do faculty members actually do?
- The Validity of Teacher Ratings of Adolescents' Social Skills
- Illustrating a mixed-method approach for validating culturally specific constructs
- State Mindfulness Scale (SMS): Development and initial validation.
- Aggression Replacement Training in Norway: Outcome evaluation of 11 Norwegian student projects
- A scoping review of measures to assess health professionals’ competencies related to health literacy
- Gender Stereotype Reinforcement: Measuring the Gender Bias Conveyed by\n Ranking Algorithms
- Validation of a measure of the Satter eating competence model with low-income females. [europepmc]
- Resident physician well-being and assessments of their knowledge and clinical performance. [europepmc]
- Dispositional drinking motives: associations with appraised alcohol effects and alcohol consumption in an ecological momentary assessment investigation. [europepmc]
- Instrumentation issues in implementation science. [europepmc]
- Psychometric evaluation of the Disabilities of the Arm, Shoulder and Hand (DASH) with Dupuytren's contracture: validity evidence using Rasch modeling. [europepmc]
- TBI-QOL: Development and Calibration of Item Banks to Measure Patient Reported Outcomes Following Traumatic Brain Injury. [europepmc]
- Advancing implementation science through measure development and evaluation: a study protocol. [europepmc]
- The use of the Godin-Shephard Leisure-Time Physical Activity Questionnaire in oncology research: a systematic review. [europepmc]
- Validating the social responsiveness scale for adults with autism. [europepmc]
- Psychometric assessment of three newly developed implementation outcome measures. [europepmc]
- Recent advances in analysis of differential item functioning in health research using the Rasch model. [europepmc]
- Physical activity and negative affective reactivity in daily life. [europepmc]
- The Assessment of Competency in Thoracic Sonography (ACTS) scale: validation of a tool for point-of-care ultrasound. [europepmc]
- Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity. [europepmc]
- Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. [europepmc]
- Lung ultrasound training: a systematic review of published literature in clinical lung ultrasound training. [europepmc]
- The development and psychometric evaluation of the Chinese Big Five Personality Inventory-15. [europepmc]
- The expansion and validation of a new upper extremity item bank for the Patient-Reported Outcomes Measurement Information System® (PROMIS). [europepmc]
- Validation of a competence-based assessment of medical students' performance in the physician's role. [europepmc]
- Frailty and Social Isolation: Comparing the Relationship between Frailty and Unidimensional and Multifactorial Models of Social Isolation. [europepmc]
- The relationship between learner engagement and teaching effectiveness: a novel assessment of student engagement in continuing medical education. [europepmc]
- Making it stick: use of active learning strategies in continuing medical education. [europepmc]
- Implications of response shift for micro-, meso-, and macro-level healthcare decision-making using results of patient-reported outcome measures. [europepmc]
- Thinking thrice about sum scores, and then some more about measurement and analysis. [europepmc]
- Structural validity of the Eating Disorder Examination-Questionnaire: A systematic review. [europepmc]
Related