Survey response rates: Trends and a validity assessment framework
2022/02/01 by Brooks Holtom, Brooks C. Holtom, Yehuda Baruch +3 · 30 citations
Social Sciences · Psychology · #Survey Methodology and Nonresponse #Focus Groups and Qualitative Methods #Behavioral Health and Interventions
paper · doi:10.1177/00187267211070769
Abstract
Survey methodology has been and continues to be a pervasively used data-collection method in social science research. To better understand the state of the science, we first analyze response-rate information reported in 1014 surveys described in 703 articles from 17 journals from 2010 to 2020. Results showed a steady increase in average response rate from 48% in 2005 to 53% in 2010 to 56% in 2015 and 68% in 2020; a marked increase in the number of surveys per published article from 1.27 in 2015 to 1.79 in 2020; and that variables that predict response-rate fluctuations over time are related to research design (e.g. data-collection medium), participant motivation (e.g. incentives), and researcher motivation (i.e. number of surveys per article). Second, we propose complementary information on contemporary response-rate norms and benchmarks with a response-rate validity assessment framework to gather evidence on accuracy of inferences based on a particular response-rate level. Implementing this validation process involves gathering information on the researcher–participant relationship, participant qualifications and motivation, survey length and complexity, and cultural and national context. Future survey research should implement the validity assessment framework in addition to reporting the response-rate value to better indicate a sample’s quality, appropriateness, and representativeness.
Citations
Cited by
- Responsible cat ownership: the status quo on past attempts, current efforts and future aspirations of local governments in Western Australia
- HRQoL in adolescents with idiopathic isolated GHD: rhGH (dis)continuation in mid-puberty
- Trends in full-time working in general practice: a repeated cross-sectional study
- Men's Economic Abuse Toward Women in Sweden: Findings From a National Survey
- ‘Better together’: Evidence on the joint adoption of circular economy and industry 4.0 technologies
- What Makes You a Whistleblower? A Multi-Country Field Study on the Determinants of the Intention to Report Wrongdoing. [europepmc]
- Air pollution and perception-based averting behaviour in the Jinchuan mining area, China. [europepmc]
- Engaging Public Health Alumni in the Tracking of Career Trends: Results From a Large-Scale Experiment on Survey Fielding Mode. [europepmc]
- Emotions as social information in unambiguous situations: role of emotions on procedural justice perception. [europepmc]
- Structural equation modelling of ethicomoral values and competence of nurses during the COVID-19 pandemic. [europepmc]
- Culture, diversity and inclusion: a survey of British Hip Society members. [europepmc]
- Interprofessional communication skills training to improve medical students' and nursing trainees' error communication - quasi-experimental pilot study. [europepmc]
- Trends in full-time working in general practice: a repeated cross-sectional study. [europepmc]
- Outpatient care for facial palsy-a survey on patient satisfaction in uni- and interdisciplinary approaches. [europepmc]
- Individual and Interactive Effects of Housing and Neighborhood Quality on Mental Health in Hong Kong: A Retrospective Cohort Study. [europepmc]
- Healthcare Providers' and Pregnant People's Preferences for a Preventive to Protect Infants from Serious Illness Due to Respiratory Syncytial Virus. [europepmc]
- Men's Economic Abuse Toward Women in Sweden: Findings From a National Survey. [europepmc]
- Translation, cultural adaptation, and validation of the Nurse Self-Concept Questionnaire (NSCQ) for Portuguese nursing students. [europepmc]
- Blended e-learning and certification for medicines development professionals: results of a 7-year collaboration between King's College, London and the GMDP Academy, New York. [europepmc]
- The challenges of recruiting never-smokers with chronic obstructive pulmonary disease from the large population-based Swedish CArdiopulmonary bioImage study (SCAPIS) cohort. [europepmc]
- Tumor board simulation improves interdisciplinary decision-making in medical students. [europepmc]
- Cat Caring Behaviors and Ownership Status of Residents Enrolling a Cat in a Free Sterilization Program. [europepmc]
- Attrition in a large-scale habituation task administered at home. [europepmc]
- Development and validation of the General attitude towards Medication Questionnaire (GAMQ). [europepmc]
- Technology frustration in healthcare - does it matter in staff ratings of stress, emotional exhaustion, and satisfaction with care? A cross-sectional correlational study using the job demands-resources theory. [europepmc]
- The impact of social media use on tolerance, community peace, online ethical awareness among adolescents in the United Arab Emirates. [europepmc]
- Using administrative register data for adjusting non-response bias in the finnish gambling harms survey. [europepmc]
- Examining the relationship between empathetic leadership and organizational citizenship behavior in the architecture, engineering, and construction industry: the roles of altruistic attitude and caring ethical climate. [europepmc]
- Parental expectations and nocebo by proxy effects in adolescent orthodontic treatment outcomes. [europepmc]
- "With a little help from my friends" - collaborating with community experts to improve sampling and obtain a high response rate for a statewide naloxone availability survey. [europepmc]
Related