Experiments in Producing Nonresponse Bias
2006/01/01 by Robert M. Groves, Mick P. Couper, Stanley Presser +4 · 1 voice · 20 citations
Social Sciences · Economics, Econometrics and Finance · #Survey Methodology and Nonresponse #Healthcare Policy and Management #Economic and Environmental Valuation
paper · doi:10.1093/poq/nfl036
Abstract
While nonresponse rates in household surveys are increasing in most industrialized nations, the increasing rates do not always produce nonresponse bias in survey estimates. The linkage between nonresponse rates and nonresponse bias arises from the presence of a covariance between response propensity and the survey variables of interest. To understand the covariance term, researchers must think about the common influences on response propensity and the survey variable. Three variables appear to be especially relevant in this regard: interest in the survey topic, reactions to the survey sponsor, and the use of incentives. A set of randomized experiments tests whether those likely to be interested in the stated survey topic participate at higher rates and whether nonresponse bias on estimates involving variables central to the survey topic is affected by this. The experiments also test whether incentives disproportionately increase the participation of those less interested in the topic. The experiments show mixed results in support of these key hypotheses.
Cited by
- The Use and Effects of Incentives in Surveys
- The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis
- Organizations and Survey Research
- Designing Passwords for Web Survey Access: The Effects of Password Length and Complexity on Survey and Panel Recruitment
- The baseline examinations of the German National Cohort (NAKO): recruitment protocol, response, and weighting
- Response rates to a mailed survey of a representative sample of cancer patients randomly drawn from the Pennsylvania Cancer Registry: a randomized trial of incentive and length effects. [europepmc]
- Comparison of participants and non-participants to the ORISCAV-LUX population-based study on cardiovascular risk factors in Luxembourg. [europepmc]
- Pre-notification letter type and response rate to a postal survey among women who have recently given birth. [europepmc]
- Mechanisms and direction of allocation bias in randomised clinical trials. [europepmc]
- The importance of friends and family to recreational gambling, at-risk gambling, and problem gambling. [europepmc]
- Study invitations with envelopes made from recycled paper do not increase likelihood of active responses or study participation in the German National Cohort. [europepmc]
- Comparison of attitudes, awareness, and perceptions regarding oral healthcare between dental and nursing students before and after oral healthcare education. [europepmc]
- The Quality of Data on Participation in Adult Education and Training. An Analysis of Varying Participation Rates and Patterns Under Consideration of Survey Design and Measurement Effects. [europepmc]
- Impact of different cover letter content and incentives on non-response bias in a sample of Veterans applying for Department of Veterans Affairs disability benefits: a randomized, 3X2X2 factorial trial. [europepmc]
- Healthy and Sustainable Food Shopping: A Survey of Intentions and Motivations. [europepmc]
- Development of interprofessional education programmes in nursing care and oral healthcare for dental and nursing students. [europepmc]
- Comparing COVID-19 literacy and vaccine hesitancy among health care workers, including oral health professionals, in Japan. [europepmc]
- The baseline examinations of the German National Cohort (NAKO): recruitment protocol, response, and weighting. [europepmc]
- Designing Passwords for Web Survey Access: The Effects of Password Length and Complexity on Survey and Panel Recruitment. [europepmc]
- A Survey of Oral Assessment and Healthcare Education at Nursing Schools in Japan [europepmc]
Discussions
Related