2025/10/10 by James Whiffing, Tobias Langlotz, Christof Lutteroth +2 · 1 voice
Engineering · Neuroscience · Psychology · #Motor Control and Adaptation #Robot Manipulation and Learning #Visual and Cognitive Learning Processes
paper · doi:10.1145/3770583
openalex publication_date 2025/10/10 · openalex created_date 2025/10/11 · openalex updated_date 2026/07/02
Freehand pointing is a fundamental gesture commonly used for cursorless interactions. Prior work in HCI often elicits the same pointing behaviour—facing the target with an outstretched dominant arm and index finger. However, freehand pointing outside of HCI shows more variability across hand pose, usage, and coordination with gaze. To understand what variability exists and how it affects pointing performance, we collected data (N = 23) using a hybrid motion capture system. To elicit a wide variety of pointing behaviours, we included different levels of user effort and attention, as well as the widest range of target placements studied. We systematically characterised and described three distinct pointing behaviours, each with three different traits, ranging from accurate stereotypical pointing observed in prior works to more casual hip fire-style pointing. Our analysis demonstrates how different pointing behaviours affect pointing performance and highlights their importance when designing interactive systems for more naturalistic freehand pointing.