Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity
2008/12/01 by Frauke Kreuter, F. Kreuter, Stanley Presser +3 · 38 citations
Social Sciences · Mathematics · #Survey Methodology and Nonresponse #Social and Intergroup Psychology #Survey Sampling and Estimation Techniques
paper · pdf · doi:10.1093/poq/nfn063
Abstract
Although it is well established that self-administered questionnaires tend to yield fewer reports in the socially desirable direction than do interviewer-administered questionnaires, less is known about whether different modes of self-administration vary in their effects on socially desirable responding. In addition, most mode comparison studies lack validation data and thus cannot separate the effects of differential nonresponse bias from the effects of differences in measurement error. This paper uses survey and record data to examine mode effects on the reporting of potentially sensitive information by a sample of recent university graduates. Respondents were randomly assigned to one of three modes of data collection-conventional computer-assisted telephone interviewing (CATI), interactive voice recognition (IVR), and the Web-and were asked about both desirable and undesirable attributes of their academic experiences. University records were used to evaluate the accuracy of the answers and to examine differences in nonresponse bias by mode. Web administration increased the level of reporting of sensitive information and reporting accuracy relative to conventional CATI, with IVR intermediate between the other two modes. Both mode of data collection and the actual status of the respondent influenced whether respondents found an item sensitive.
Cited by
- Priming Patriots: Social Identity Processes and the Dynamics of Public Support for War
- Research Synthesis: AAPOR Report on Online Panels
- Simulating Subjects: The Promise and Peril of Artificial Intelligence Stand-Ins for Social Agents and Interactions
- Method Bias Mechanisms and Procedural Remedies
- Reducing meat consumption: Results from a German survey on attitudes, behaviour and willingness to change among adults
- ‘The Economy is Rigged’: Inequality Narratives, Fairness, and Support for Redistribution in Six Countries
- Health monitoring at the Robert Koch Institute – Effects of a change in study design on sample composition and prevalence estimates due to the start of the ‘Health in Germany’ panel
- Typing or Speaking? Comparing Text and Voice Answers to Open Questions on Sensitive Topics in Smartphone Surveys
- How Do Internet-Related Characteristics Affect Whether Members of a German Mixed-Mode Panel Switch from the Mail to the Web Mode?
- New Developments in Survey Data Collection
- Invalidating Factorial Survey Experiments Using Invalid Comparisons Is Bad Practice: Learning from Forster and Neugebauer (2024)
- Social Desirability and Political Sensitivity: Interviewer Gender Effects on Men in Five Arab Countries
- Effects of Embodied Interviewing Agents on Open Narrative Responses
- Institutional sources of legitimacy for international organisations: Beyond procedure versus performance
- The Influence of a Person’s Digital Affinity on Unit Nonresponse and Attrition in an Online Panel
- Backlash by Men against the Socio-Economic and Political Promotion of Women in Europe
- A Comparison of Four Probability-Based Online and Mixed-Mode Panels in Europe
- Does the Recruitment of Offline Households Increase the Sample Representativeness of Probability-Based Online Panels? Evidence From the German Internet Panel
- Participants’ Reported Discomfort with Live Video as a Mode for Answering a Sensitive Survey Question
- The Strengthening of Partisan Affect
- Integrating smart surveys with traditional surveys
- Evaluating Methods to Prevent and Detect Inattentive Respondents in Web Surveys
- Three Approaches to Improve Inferences Based on Survey Data Collected with Mixed-mode Designs
- Differences Between New and Long-Standing US Gun Owners: Results From a National Survey
- The Normalization of the Radical Right
- The Impact of Mixing Survey Modes on Estimates of Change: A Quasi-Experimental Study
- Mic Drop or Data Flop? Evaluating the Fitness for Purpose of AI Voice Interviewers for Data Collection within Quantitative & Qualitative Research Contexts
- Navigating the digital landscape: Exploring the relationship between social media affordances and Chinese Generation Z’s online prosocial and antisocial behaviors
- Small networks and high isolation? A reexamination of American discussion networks
- Traditional Police Culture, Use of Force, and Procedural Justice: Investigating Individual, Organizational, and Contextual Factors
- Online Surveys are Mixed-Device Surveys. Issues Associated with the Use of Different (Mobile) Devices in Web Surveys
- Discrepancies between perceived accessibility and spatial accessibility modelling: A case study of urban parks in Guangzhou, China
- Toward a New Approach to Creating Population-Representative Data for Demographic Research
- When trust turns digital: why relational cues matter in online crime-reporting portals
- Deepfakes and Disinformation: Exploring the Impact of Synthetic Political Video on Deception, Uncertainty, and Trust in News
- Data quality and response distributions in a mixed-mode survey
- Mode effect [wikipedia]
- Questionnaire construction [wikipedia]
Related