Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning.
1995/09/01 by Samuel Messick · 4,026 citations
Decision Sciences · Psychology · #Applied psychology #Clinical psychology #Meaning (existential) #Motivation and Self-Concept in Sports #Psychological Testing and Assessment #Psychological science #Psychology #Psychometric Methodologies and Testing #Psychometrics #Psychotherapist #Social psychology #Test validity
paper · doi:10.1037/0003-066x.50.9.741
published in American Psychologist 50(9), 741-749 (American Psychological Association)
openalex publication_date 1995/09/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
Abstract
The traditional conception of validity divides it into three separate and substitutable types—namely, content, criterion, and construct validities. This view is fragmented and incomplete, especially because it fails to take into account both evidence of the value implications of score meaning as a basis for action and the social consequences of score use. The new unified concept of validity interrelates these issues as fundamental aspects of a more comprehensive theory of construct validity that addresses both score meaning and social values in test interpretation and test use. That is, unified validity integrates considerations of content, criteria, and consequences into a construct framework for the empirical testing of rational hypotheses about score meaning and theoretically relevant relationships, including those of an applied and a scientific nature. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of validity as a unified concept. These are content, substantive, structural, generalizability, external, and consequential aspects of construct validity. In effect, these six aspects function as general validity criteria or standards for all educational and psychological measurement, including performance assessments, which are discussed in some detail because of their increasing emphasis in educational and employment settings.
Cited by
- Measuring Learning Outcomes in Higher Education
- Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles
- Validating the Instruments to Measure ESL/EFL Learners' Self‐Efficacy Beliefs and Self‐Regulated Learning Strategies
- The Development of Epistemological Theories: Beliefs About Knowledge and Knowing and Their Relation to Learning
- Cognitive Processing of Self-Report Items in Educational Research: Do They Think What We Mean?
- Using small data to interpret big data: 311 reports as individual contributions to informal social control in urban neighborhoods
- The Hidden Measurement Crisis in Criminology
- Availability of cookies during an academic course session affects evaluation of teaching
- The Eyberg Child Behavior Inventory: Factorial invariance in problem behaviors across gender and age
- A validated toolkit for access and participation evaluation (TAPE)
- The Geographic Distribution of Big Five Personality Traits
- The development and validation of an L2 student digital multimodal composing competence scale
- Developing and Validating a Diagnostic Checklist to Assess Argumentation in EFL Writing
- Looking for Renaissance People: Examining Domain Specificity-Generality of Creativity Using Item Response Theory Models
- Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments
- A dialectic on validity: Explanation-focused and the many ways of being human
- Exploring Validity Evidence for Mathematics Self-Concept of Adolescents: Key Findings from PISA 2022
- Measuring the effects of Crime Prevention Through Environmental Design (CPTED) on fear of crime in public spaces
- Social media emotions annotation guide (SMEmo): Development and initial validity
- A Typology of Mixed Methods Sampling Designs in Social Science Research
- Aligning Patient Discharge Curricula to Patient-Reported Outcomes in Sub Internship
- Measuring what learners do in feedback: the feedback literacy behaviour scale
- The Survey Checklist (Manifesto)
- Development and Initial Validation of the Shame Frequency Questionnaire in Medical Students
- The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes
- Psychology's Questionable Research Fundamentals (QRFs): Key problems in quantitative psychology and psychological measurement beyond Questionable Research Practices (QRPs)
- Unpacking the digital literacy–self-regulated learning nexus: A systematic review and a three-level meta-analysis
- A meta-analytic review of authentic and transformational leadership: A test for redundancy
- Conceptual Complexity and Construct Validity
- Quantitative Research On the Primary Process: Method and Findings
- When Can AI Models Explain Learning? Validity Criteria for AI as Cognitive Models in Education
- Psychometrically derived 60-question benchmarks: Substantial efficiencies and the possibility of human-AI comparisons
- Understanding Implicit Bias: Putting the Criticism into Perspective
- The Meaning of Validity in the New Standards for Educational and Psychological Testing:
- The Implicit Association Test: A Method in Search of a Construct
- Construct Meaning in Multilevel Settings
- Developing an objective measure of knowledge of factory farming
- A qualitative study of validation practices in classroom-based assessment in health professions education: what do faculty members actually do?
- The Validity of Teacher Ratings of Adolescents' Social Skills
- Illustrating a mixed-method approach for validating culturally specific constructs
- State Mindfulness Scale (SMS): Development and initial validation.
- Aggression Replacement Training in Norway: Outcome evaluation of 11 Norwegian student projects
- Developing a short language classroom engagement scale (LCES) and linking it with needs satisfaction and achievement
- A scoping review of measures to assess health professionals’ competencies related to health literacy
- Gender Stereotype Reinforcement: Measuring the Gender Bias Conveyed by\n Ranking Algorithms
- Validity : Historical and Psychometric Perspectives
- Generative AI , virtual reality simulation and communication entrustment in competency‐based medical education
- Simplifying Preclinical Periodontal Instrumentation Assessment: A Pass/Fail Rubric Approach
- Teachers' professional vision, pedagogical content knowledge and beliefs: On its relation and differences between pre-service and in-service teachers
- Criteria for Selection and Evaluation of Scales and Measures
- Development and Validation of a Scale for Measuring Instructors' Attitudes toward Concept-Based or Reform-Oriented Teaching of Introductory Statistics in the Health and Behavioral Sciences
- Normalizing the Use of Single-Item Measures: Validation of the Single-Item Compendium for Organizational Psychology
- Validity: on the meaningful interpretation of assessment data
- An Exploratory Study Using Innovative Graphical Network Analysis to Model Eye Movements in Spatial Reasoning Problem Solving
- Assessing Personality States: What to Consider when Constructing Personality State Measures
- Methods and Data Analysis for Cross-Cultural Research
- Structural Validity of the WISC-IV for Students With Learning Disabilities
- Anxiety and impulsivity: Factors associated with premature graying in young dogs
- Workplace mistreatment climate and potential employee and organizational outcomes: A meta-analytic review from the target’s perspective.
- Unicorns or Tiger Woods: Are lie detection experts myths or rarities? A response to On lie detection "Wizards' by Bond and Uysal.
- Road Maps for Learning: A Guide to the Navigation of Learning Progressions
- What Does the Cognitive Assessment System (CAS) Measure? Joint Confirmatory Factor Analysis of the CAS and the Woodcock-Johnson Tests of Cognitive Ability (3rd Edition)
- Implicit theories of online trolling: Evidence that attention‐seeking conceptions are associated with increased psychological resilience
- Integrating multi-informant reports of youth mental health: A construct validation test of Kraemer and colleagues’ (2003) Satellite Model
- Bias in mental testing since Bias in Mental Testing.
- Safety climate and injuries: An examination of theoretical and empirical relationships.
- Intelligence testing and social policy
- Unresolved issues in measurement validity: An autobiographical overview.
- The Scientific Status of Projective Techniques
- Confidence intervals for standardized linear contrasts of means.
- Validity evidence of the use of quantitative measures of students in elementary mathematics education
- Validation of a measure of the Satter eating competence model with low-income females. [europepmc]
- Resident physician well-being and assessments of their knowledge and clinical performance. [europepmc]
- Dispositional drinking motives: associations with appraised alcohol effects and alcohol consumption in an ecological momentary assessment investigation. [europepmc]
- Instrumentation issues in implementation science. [europepmc]
- Psychometric evaluation of the Disabilities of the Arm, Shoulder and Hand (DASH) with Dupuytren's contracture: validity evidence using Rasch modeling. [europepmc]
- TBI-QOL: Development and Calibration of Item Banks to Measure Patient Reported Outcomes Following Traumatic Brain Injury. [europepmc]
- Advancing implementation science through measure development and evaluation: a study protocol. [europepmc]
- The use of the Godin-Shephard Leisure-Time Physical Activity Questionnaire in oncology research: a systematic review. [europepmc]
- Validating the social responsiveness scale for adults with autism. [europepmc]
- Psychometric assessment of three newly developed implementation outcome measures. [europepmc]
- Recent advances in analysis of differential item functioning in health research using the Rasch model. [europepmc]
- Physical activity and negative affective reactivity in daily life. [europepmc]
- The Assessment of Competency in Thoracic Sonography (ACTS) scale: validation of a tool for point-of-care ultrasound. [europepmc]
- Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity. [europepmc]
- Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. [europepmc]
- Lung ultrasound training: a systematic review of published literature in clinical lung ultrasound training. [europepmc]
- The development and psychometric evaluation of the Chinese Big Five Personality Inventory-15. [europepmc]
- The expansion and validation of a new upper extremity item bank for the Patient-Reported Outcomes Measurement Information System® (PROMIS). [europepmc]
- Validation of a competence-based assessment of medical students' performance in the physician's role. [europepmc]
- Frailty and Social Isolation: Comparing the Relationship between Frailty and Unidimensional and Multifactorial Models of Social Isolation. [europepmc]
- The relationship between learner engagement and teaching effectiveness: a novel assessment of student engagement in continuing medical education. [europepmc]
- Making it stick: use of active learning strategies in continuing medical education. [europepmc]
- Implications of response shift for micro-, meso-, and macro-level healthcare decision-making using results of patient-reported outcome measures. [europepmc]
- Thinking thrice about sum scores, and then some more about measurement and analysis. [europepmc]
- Structural validity of the Eating Disorder Examination-Questionnaire: A systematic review. [europepmc]
Related