vix.ing · top · new · best · stats · spec

ComPC: Completing a 3D Point Cloud with 2D Diffusion Priors

2024/04/10 by Tianxin Huang, Huang, Tianxin, Zhiwen Yan +5 · 1 citation
Physics and Astronomy · Engineering · #Advanced Optical Sensing Technologies #Advanced X-ray and CT Imaging #Random lasers and scattering media

paper · pdf · doi:10.48550/arxiv.2404.06814

Abstract

3D point clouds directly collected from objects through sensors are often incomplete due to self-occlusion. Conventional methods for completing these partial point clouds rely on manually organized training sets and are usually limited to object categories seen during training. In this work, we propose a test-time framework for completing partial point clouds across unseen categories without any requirement for training. Leveraging point rendering via Gaussian Splatting, we develop techniques of Partial Gaussian Initialization, Zero-shot Fractal Completion, and Point Cloud Extraction that utilize priors from pre-trained 2D diffusion models to infer missing regions and extract uniform completed point clouds. Experimental results on both synthetic and real-world scanned point clouds demonstrate that our approach outperforms existing methods in completing a variety of objects. Our project page is at \urlhttps://tianxinhuang.github.io/projects/ComPC/.

Cited by

Related