vix.ing · top · new · best · stats · spec

Using Multilabel Neural Network to Score High‐Dimensional Assessments for Different Use Foci: An Example with College Major Preference Assessment

2025/01/14 by Shaobin Hu, Amery D. Wu, Jake E. Stone · 1 voice
Computer Science · Decision Sciences · Business, Management and Accounting · #Advanced Text Analysis Techniques #Multi-Criteria Decision Making #Quality Function Deployment in Product Design

paper · doi:10.1111/jedm.12424

openalex publication_date 2025/01/14 · openalex created_date 2025/01/15 · openalex updated_date 2026/05/21

Abstract

Abstract Scoring high‐dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high‐dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or precision, to suit users' varying needs. These two objectives are illustrated with an example of scoring the short version of the College Majors Preference assessment (Short CMPA) to match the results of whether the 50 college majors would be in one's top three, as determined by the Long CMPA. The results reveal that MNN significantly outperforms the simple‐sum ranking method (i.e., ranking the 50 majors' subscale scores) in targeting recall (.95 vs. .68) and precision (.53 vs. .38), while gaining an additional 3% in accuracy (.94 vs. .91). These findings suggest that, when executed properly, MNN can be a flexible and practical tool for scoring numerous traits and addressing various use foci.

Citations

Discussions