EPOS: Estimating 6D Pose of Objects with Symmetries

2020/04/01 by Hodan, Tomas, Barath, Daniel, Matas, Jiri · 11 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #Robotics (cs.RO) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2004.00605

Abstract

We present a new method for estimating the 6D pose of rigid objects with available 3D models from a single RGB input image. The method is applicable to a broad range of objects, including challenging ones with global or partial symmetries. An object is represented by compact surface fragments which allow handling symmetries in a systematic manner. Correspondences between densely sampled pixels and the fragments are predicted using an encoder-decoder network. At each pixel, the network predicts: (i) the probability of each object's presence, (ii) the probability of the fragments given the object's presence, and (iii) the precise 3D location on each fragment. A data-dependent number of corresponding 3D locations is selected per pixel, and poses of possibly multiple object instances are estimated using a robust and efficient variant of the PnP-RANSAC algorithm. In the BOP Challenge 2019, the method outperforms all RGB and most RGB-D and D methods on the T-LESS and LM-O datasets. On the YCB-V dataset, it is superior to all competitors, with a large margin over the second-best RGB method. Source code is at: cmp.felk.cvut.cz/epos.

Cited by

• Orient Anything V2: Unifying Orientation and Rotation Understanding
• Learning Dense 2D-3D Correspondence for X-ray-to-CT Registration of Knee Bones
• Object Pose Distribution Estimation for Determining Revolution and Reflection Uncertainty in Point Clouds
• Reconstructing Objects along Hand Interaction Timelines in Egocentric Video
• Equivariant symmetry-aware head pose estimation for fetal MRI
• Is Image-based Object Pose Estimation Ready to Support Grasping?
• Uncertainty Quantification for Visual Object Pose Estimation
• WALDO: Where Unseen Model-based 6D Pose Estimation Meets Occlusion
• CoordAR: One-Reference 6D Pose Estimation of Novel Objects via Autoregressive Coordinate Map Generation
• Monocular Visual 8D Pose Estimation for Articulated Bicycles and Cyclists
• MVTOP: Multi-View Transformer-based Object Pose-Estimation

Related

• Pose Estimation of Specific Rigid Objects
• SC6D: Symmetry-agnostic and Correspondence-free 6D Object Pose Estimation
• ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework
• BOP-Distrib: Revisiting 6D Pose Estimation Benchmarks for Better Evaluation under Visual Ambiguities
• Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation