2025/01/29 by Christie M. Fuller, Marcia J. Simmering, Brian Waterwall +3 · 1 citation
Mathematics · Medicine · Psychology · Social Sciences · #Affect (linguistics) #Applied psychology #Behavioral Health and Interventions #Communication #Mathematics #Medicine #Post hoc #Psychological intervention #Psychology #Quality (philosophy) #Social and Intergroup Psychology #Social psychology #Statistics #Survey Methodology and Nonresponse #Survey data collection #Survey research
paper · open access · doi:10.1177/00131644241311851
published in Educational and Psychological Measurement 85(4), 696-727 (SAGE Publishing)
openalex publication_date 2025/01/29 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/25
Social and behavioral science researchers who use survey data are vigilant about data quality, with an increasing emphasis on avoiding common method variance (CMV) and insufficient effort responding (IER). Each of these errors can inflate and deflate substantive relationships, and there are both a priori and post hoc means to address them. Yet, little research has investigated how both IER and CMV are affected with the use of these different procedural or statistical techniques used to address them. More specifically, if interventions to reduce IER are used, does this affect CMV in data? In an experiment conducted both in and out of the laboratory, we investigate the impact of attentiveness interventions, such as a Factual Manipulation Check (FMC) on both IER and CMV in same-source survey data. In addition to typical IER measures, we also track whether respondents play the instructional video and their mouse movement. The results show that while interventions have some impact on the level of participant attentiveness, these interventions do not appear to lead to differing levels of CMV.