vix.ing · top · new · best · stats · spec

Generative Range Imaging for Learning Scene Priors of 3D LiDAR Data

2022/10/21 by Kazuto Nakashima, Nakashima, Kazuto, Yumi Iwashita +3 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Advanced Vision and Imaging #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image Processing Techniques and Applications #Image and Video Processing (eess.IV) #Robotics (cs.RO) #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2210.11750

openalex publication_date 2022/10/21 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

3D LiDAR sensors are indispensable for the robust vision of autonomous mobile robots. However, deploying LiDAR-based perception algorithms often fails due to a domain gap from the training environment, such as inconsistent angular resolution and missing properties. Existing studies have tackled the issue by learning inter-domain mapping, while the transferability is constrained by the training configuration and the training is susceptible to peculiar lossy noises called ray-drop. To address the issue, this paper proposes a generative model of LiDAR range images applicable to the data-level domain transfer. Motivated by the fact that LiDAR measurement is based on point-by-point range imaging, we train an implicit image representation-based generative adversarial networks along with a differentiable ray-drop effect. We demonstrate the fidelity and diversity of our model in comparison with the point-based and image-based state-of-the-art generative models. We also showcase upsampling and restoration applications. Furthermore, we introduce a Sim2Real application for LiDAR semantic segmentation. We demonstrate that our method is effective as a realistic ray-drop simulator and outperforms state-of-the-art methods.

Cited by

Related