2023/09/04 by Micol Spitale, Spitale, Micol, Rebecca Stower +11 · 1 citation
Computer Science · Decision Sciences · #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Robotics (cs.RO) #Scientific Computing and Data Management #Software Engineering Research
paper · pdf · doi:10.48550/arxiv.2309.01822
openalex publication_date 2023/09/04 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Research reproducibility - i.e., rerunning analyses on original data to replicate the results - is paramount for guaranteeing scientific validity. However, reproducibility is often very challenging, especially in research fields where multi-disciplinary teams are involved, such as child-robot interaction (CRI). This paper presents a systematic review of the last three years (2020-2022) of research in CRI under the lens of reproducibility, by analysing the field for transparency in reporting. Across a total of 325 studies, we found deficiencies in reporting demographics (e.g. age of participants), study design and implementation (e.g. length of interactions), and open data (e.g. maintaining an active code repository). From this analysis, we distill a set of guidelines and provide a checklist to systematically report CRI studies to help and guide research to improve reproducibility in CRI and beyond.