Rule Of Thumb: Deep derotation for improved fingertip detection

2015/07/21 by Aaron Wetzler, Wetzler, Aaron, Ron Slossberg +3
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.CV

paper · pdf · doi:10.48550/arxiv.1507.05726

To be published in proceedings of BMVC 2015

arxiv created 2015/07/21 · arxiv updated 2015/07/22

Abstract

We investigate a novel global orientation regression approach for articulated objects using a deep convolutional neural network. This is integrated with an in-plane image derotation scheme, DeROT, to tackle the problem of per-frame fingertip detection in depth images. The method reduces the complexity of learning in the space of articulated poses which is demonstrated by using two distinct state-of-the-art learning based hand pose estimation methods applied to fingertip detection. Significant classification improvements are shown over the baseline implementation. Our framework involves no tracking, kinematic constraints or explicit prior model of the articulated object in hand. To support our approach we also describe a new pipeline for high accuracy magnetic annotation and labeling of objects imaged by a depth camera.

Related

• Hand Segmentation and Fingertip Tracking from Depth Camera Images Using Deep Convolutional Neural Network and Multi-task SegNet
• Fingertip in the Eye: A cascaded CNN pipeline for the real-time fingertip detection in egocentric videos
• Two-stream convolutional neural network for accurate RGB-D fingertip detection using depth and edge information
• Hand Pose Estimation through Semi-Supervised and Weakly-Supervised Learning
• Towards Good Practices for Deep 3D Hand Pose Estimation