vix.ing · top · new · best · stats · spec

Discovering the critical number of respondents to validate an item in a questionnaire: The Binomial Cut-level Content Validity proposal

2024/10/15 by Costa, Helder Gomes, Shimoda, Eduardo, Costa, José Fabiano da Serra +2
#62P05 #62P10 #62P12 #62P15 #62P20 #62P25 #90B50 #90C29 #90C31 #91A35 #91B06 #Applications (stat.AP) #FOS: Computer and information sciences #G.3 #H.4 #H.4.2 #Information Theory (cs.IT) #Methodology (stat.ME)

paper · doi:10.48550/arxiv.2410.11151

Abstract

The question that drives this research is: "How to discover the number of respondents that are necessary to validate items of a questionnaire as actually essential to reach the questionnaire's proposal?" Among the efforts in this subject, \citeLawshe1975, Wilson2012, AyreCVR2014 approached this issue by proposing and refining the Content Validation Ratio (CVR) that looks to identify items that are actually essentials. Despite their contribution, these studies do not check if an item validated as "essential" should be also validated as "not essential" by the same sample, which should be a paradox. Another issue is the assignment a probability equal a 50% to a item be randomly checked by a respondent as essential, despite an evaluator has three options to choose. Our proposal faces these issues, making it possible to verify if a paradoxical situation occurs, and being more precise in recommending whether an item should either be retained or discarded from a questionnaire.

Related