vix.ing · top · new · best · stats

The Interplay of Evidence and Consequences in the Validation of Performance Assessments

1994/03/01 by Samuel Messick · 1,313 citations
Psychology · Social Sciences · #Artificial intelligence #Cognitive psychology #Competence (human resources) #Computer science #Construct (python library) #Construct validity #Context (archaeology) #Developmental psychology #Educational and Psychological Assessments #Innovative Education and Learning Practices #Psychology #Psychometrics #Salient #Social psychology #Student Assessment and Feedback

paper · doi:10.3102/0013189x023002013

published in Educational Researcher 23(2), 13-23 (SAGE Publishing)

openalex publication_date 1994/03/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/25

Abstract

Authentic and direct assessments of performances and products are examined in the light of contrasting functions and purposes having implications for validation, especially with respect to the need for specialized validity criteria tailored for performance assessment. These include contrasts between performances and products, between assessment of performance per se and performance assessment of competence or other constructs, between structured and unstructured problems and response modes, and between breadth and depth of domain coverage. These distinctions are elaborated in the context of an overarching contrast between task-driven and construct-driven performance assessment. Rhetoric touting performance assessments because they eschew decomposed skills and decontextualized tasks is viewed as misguided, in that component skills and abstract problems have a legitimate place in pedagogy. Hence, the essence of authentic assessment must be sought elsewhere, that is, in the quest for complete construct representation. With this background, the concepts of “authenticity” and “directness” of performance assessment are treated as tantamount to promissory validity claims that they offset, respectively, the two major threats to construct validity, namely, construct underrepresentation and construct-irrelevant variance. With respect to validation, the salient role of both positive and negative consequences is underscored as well as the need, as in all assessment, for evidence of construct validity.

Citations

Cited by

Related