A Comparison of Alternative Indicators for the Risk of Nonresponse Bias

2012/09/01 by J. Wagner, James Wagner · 87 citations
Mathematics · Psychology · Social Sciences · #Computer science #Econometrics #Economics #Mathematics #Missing data #Non-response bias #Psychology #Response bias #Social psychology #Sociology #Statistical Methods and Bayesian Inference #Statistics #Strengths and weaknesses #Survey Methodology and Nonresponse #Typology

paper · pdf · doi:10.1093/poq/nfs032

published in Public Opinion Quarterly 76(3), 555-575 (Oxford University Press)

openalex publication_date 2012/09/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/29

Abstract

The response rate has played a key role in measuring the risk of nonresponse bias. However, recent empirical evidence has called into question the utility of the response rate for predicting nonresponse bias. The search for alternatives to the response rate has begun. The present article offers a typology for these indicators, briefly describes the strengths and weaknesses of each type, and suggests directions for future research. New standards for reporting on the risk of nonresponse bias may be needed. Certainly, any analysis into the risk of nonresponse bias will need to be multifaceted and include sensitivity analyses designed to test the impact of key assumptions about the data that are missing due to nonresponse.

Citations

• Consequences of Reducing Nonresponse in a National Telephone Survey
• The Effects of Response Rate Changes on the Index of Consumer Sentiment
• Measurement Error, Unit Nonresponse, and Self-Reports of Abortion Experiences
• Survey Participation, Nonresponse Bias, Measurement Error Bias, and Total Bias
• Nonresponse Rates and Nonresponse Bias in Household Surveys
• The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis
• The Role of Topic Interest in Survey Participation Decisions

Cited by

• Financial Statement Quality and Debt Contracting: Evidence from a Survey of Commercial Lenders
• Alternative indicators for the risk of non-response bias: a simulation study. [europepmc]
• Advancing regulatory science and assessment of FDA REMS programs: A mixed-methods evaluation examining physician survey response. [europepmc]
• Sensitive Periods for the Effect of Child Maltreatment on Psychopathology Symptoms in Adolescence. [europepmc]
• Virtually isolated: social identity threat predicts social approach motivation via sense of belonging in computer-supported collaborative learning. [europepmc]

Related

• The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis
• Nonresponse Rates and Nonresponse Bias in Household Surveys
• Experiments in Producing Nonresponse Bias
• Estimating Nonresponse Bias in Mail Surveys
• Against All Odds: On the Robustness of Probability Samples Against Decreases in Response Rates