vix.ing · top · new · best · stats · spec

Who's cheating on your survey? A detection approach with digital trace data

2022/11/27 by Simon Munzert, Sebastian Ramirez-Ruiz, Pablo Barberá +2 · 1 voice · 1 citation
Social Sciences · #Electoral Systems and Political Participation #Media Influence and Politics #Experimental Behavioral Economics Studies

paper · pdf · doi:10.1017/psrm.2022.42

openalex publication_date 2022/11/27 · openalex created_date 2022/11/30 · openalex updated_date 2026/08/03

Abstract

Abstract In this note, we provide direct evidence of cheating in online assessments of political knowledge. We combine survey responses with web tracking data of a German and a US online panel to assess whether people turn to external sources for answers. We observe item-level prevalence rates of cheating that range from 0 to 12 percent depending on question type and difficulty, and find that 23 percent of respondents engage in cheating at least once across waves. In the US panel, which employed a commitment pledge, we observe cheating behavior among less than 1 percent of respondents. We find robust respondent- and item-level characteristics associated with cheating. However, item-level instances of cheating are rare events; as such, they are difficult to predict and correct for without tracking data. Even so, our analyses comparing naive and cheating-corrected measures of political knowledge provide evidence that cheating does not substantially distort inferences.

Cited by

Discussions

Related