Cross-Shape Attention for Part Segmentation of 3D Point Clouds

2020/03/20 by Loizou, Marios, Garg, Siddhant, Petrov, Dmitry +2 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Graphics (cs.GR) #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2003.09053

Abstract

We present a deep learning method that propagates point-wise feature representations across shapes within a collection for the purpose of 3D shape segmentation. We propose a cross-shape attention mechanism to enable interactions between a shape's point-wise features and those of other shapes. The mechanism assesses both the degree of interaction between points and also mediates feature propagation across shapes, improving the accuracy and consistency of the resulting point-wise feature representations for shape segmentation. Our method also proposes a shape retrieval measure to select suitable shapes for cross-shape attention operations for each test shape. Our experiments demonstrate that our approach yields state-of-the-art results in the popular PartNet dataset.

Cited by

• SegGraph: Leveraging Graphs of SAM Segments for Few-Shot 3D Part Segmentation
• DexVLG: Dexterous Vision-Language-Grasp Model at Scale

Related

• PointCAT: Cross-Attention Transformer for point cloud
• CloudAttention: Efficient Multi-Scale Attention Scheme For 3D Point Cloud Learning
• Point2Sequence: Learning the Shape Representation of 3D Point Clouds with an Attention-based Sequence to Sequence Network
• PVNet: A Joint Convolutional Network of Point Cloud and Multi-View for 3D Shape Recognition
• Parts4Feature: Learning 3D Global Features from Generally Semantic Parts\n in Multiple Views