vix.ing · top · new · best · stats · spec

Robot Tactile Gesture Recognition Based on Full-body Modular E-skin

2025/06/23 by Jiang, Shuo, Hu, Boce, Zhao, Linfeng +1 · 1 citation
#FOS: Computer and information sciences #Robotics (cs.RO)

paper · doi:10.48550/arxiv.2506.18256

Abstract

With the development of robot electronic skin technology, various tactile sensors, enhanced by AI, are unlocking a new dimension of perception for robots. In this work, we explore how robots equipped with electronic skin can recognize tactile gestures and interpret them as human commands. We developed a modular robot E-skin, composed of multiple irregularly shaped skin patches, which can be assembled to cover the robot's body while capturing real-time pressure and pose data from thousands of sensing points. To process this information, we propose an equivariant graph neural network-based recognizer that efficiently and accurately classifies diverse tactile gestures, including poke, grab, stroke, and double-pat. By mapping the recognized gestures to predefined robot actions, we enable intuitive human-robot interaction purely through tactile input.

Citations

Cited by

Related