2022/01/22 by Julia R. Cordero, Cordero, Julia R., Thomas R. Groechel +3
Computer Science · Psychology · Social Sciences · #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Innovative Human-Technology Interaction #Robotics (cs.RO) #Social Robot Interaction and HRI #Technology Use by Older Adults #cs.HC #cs.RO
paper · pdf · doi:10.48550/arxiv.2201.09114
7 pages, 5 figures, 1 table
openalex publication_date 2022/01/22 · arxiv created 2022/03/03 · arxiv updated 2022/03/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Study reproducibility and generalizability of results to broadly inclusive populations is crucial in any research. Previous meta-analyses in HRI have focused on the consistency of reported information from papers in various categories. However, members of the HRI community have noted that much of the information needed for reproducible and generalizable studies is not found in published papers. We address this issue by surveying the reported study metadata over the past three years (2019 through 2021) of the main proceedings of the International Conference on Human-Robot Interaction (HRI) as well as alt.HRI. Based on the analysis results, we propose a set of recommendations for the HRI community that follow the longer-standing reporting guidelines from human-computer interaction (HCI), psychology, and other fields most related to HRI. Finally, we examine three key areas for user study reproducibility: recruitment details, participant compensation, and participant gender. We find a lack of reporting within each of these study metadata categories: of the 236 studies, 139 studies failed to report recruitment method, 118 studies failed to report compensation, and 62 studies failed to report gender data. This analysis therefore provides guidance about specific types of needed reporting improvements for HRI.