2002/10/01 by Ulf‐Dietrich Reips · 650 citations
Psychology · Social Sciences · #Behavioral Health and Interventions #Communication #Computer science #Internet privacy #Psychology #Social and Intergroup Psychology #Survey Methodology and Nonresponse #The Internet #World Wide Web
paper · pdf · doi:10.1026/1618-3169.49.4.243
published in Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) 49(4), 243-256 (Hogrefe Verlag)
openalex publication_date 2002/10/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01
This article summarizes expertise gleaned from the first years of Internet-based experimental research and presents recommendations on: (1) ideal circumstances for conducting a study on the Internet; (2) what precautions have to be undertaken in Web experimental design; (3) which techniques have proven useful in Web experimenting; (4) which frequent errors and misconceptions need to be avoided; and (5) what should be reported. Procedures and solutions for typical challenges in Web experimenting are discussed. Topics covered include randomization, recruitment of samples, generalizability, dropout, experimental control, identity checks, multiple submissions, configuration errors, control of motivational confounding, and pre-testing. Several techniques are explained, including "warm-up," "high hurdle," password methods, "multiple site entry," randomization, and the use of incentives. The article concludes by proposing sixteen standards for Internet-based experimenting.