2024/01/20 by Junxiao Shen, Matthias De Lange, Shen, Junxiao +17
Computer Science · Psychology · Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #Delphi Technique in Research #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Hearing Impairment and Communication
paper · pdf · doi:10.48550/arxiv.2401.11144
openalex publication_date 2024/01/20 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Providing users with accurate gestural interfaces, such as gesture recognition based on wrist-worn devices, is a key challenge in mixed reality. However, static machine learning processes in gesture recognition assume that training and test data come from the same underlying distribution. Unfortunately, in real-world applications involving gesture recognition, such as gesture recognition based on wrist-worn devices, the data distribution may change over time. We formulate this problem of adapting recognition models to new tasks, where new data patterns emerge, as open-world gesture recognition (OWGR). We propose the use of continual learning to enable machine learning models to be adaptive to new tasks without degrading performance on previously learned tasks. However, the process of exploring parameters for questions around when, and how, to train and deploy recognition models requires resource-intensive user studies may be impractical. To address this challenge, we propose a design engineering approach that enables offline analysis on a collected large-scale dataset by systematically examining various parameters and comparing different continual learning methods. Finally, we provide design guidelines to enhance the development of an open-world wrist-worn gesture recognition process.