2025/01/31 by Victor Hoffmann, Hoffmann, Victor, Federico Paredes-Vallés +3
Engineering · Neuroscience · #Advanced Memory and Neural Computing #Advanced Sensor and Energy Harvesting Materials #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Tactile and Sensory Interactions
paper · pdf · doi:10.48550/arxiv.2501.19174
openalex publication_date 2025/01/31 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
This work presents NeuroTouch, an optical-based tactile sensor that combines a highly deformable dome-shaped soft material with an integrated neuromorphic camera, leveraging frame-based and dynamic vision for gesture detection. Our approach transforms an elastic body into a rich and nuanced interactive controller by tracking markers printed on its surface with event-based methods and harnessing their trajectories through RANSAC-based techniques. To benchmark our framework, we have created a 25 min gesture dataset, which we make publicly available to foster research in this area. Achieving over 91% accuracy in gesture classification, a 3.41 mm finger localization distance error, and a 0.96 mm gesture intensity error, our real-time, lightweight, and low-latency pipeline holds promise for applications in video games, augmented/virtual reality, and accessible devices. This research lays the groundwork for advancements in gesture detection for vision-based soft-material input technologies. Dataset: Coming Soon, Video: Coming Soon