2025/01/07 by Kylie Gorney, Sandip Sinharay · 1 voice
Agricultural and Biological Sciences · Decision Sciences · Mathematics · Psychology · #Advanced Statistical Methods and Models #Categorical variable #Computer science #Econometrics #Mathematics #Mathematics education #Natural language processing #Psychology #Reliability and Agreement in Measurement #Sensory Analysis and Statistical Methods #Statistics
paper · pdf · doi:10.1111/jedm.12423
published in Journal of Educational Measurement 62(1), 101-119 (Wiley)
openalex publication_date 2025/01/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/05/21
Abstract Although there exists an extensive amount of research on subscores and their properties, limited research has been conducted on categorical subscores and their interpretations. In this paper, we focus on the claim of Feinberg and von Davier that categorical subscores are useful for remediation and instructional purposes. We investigate this claim by examining (a) the agreement between true and observed subscore classifications and (b) the agreement between subscore classifications across parallel forms of a test. Results show that the categorical subscores of Feinberg and von Davier are often inaccurate and/or inconsistent, pointing to a lack of justification for using them for remediation or instructional purposes.