vix.ing · top · new · best · stats · spec

Stereo Frustums: A Siamese Pipeline for 3D Object Detection

2020/10/27 by Xi Mo, Mo, Xi, Usman Sajid +4
Computer Science · Earth and Planetary Sciences · Engineering · Environmental Science · #3D Surveying and Cultural Heritage #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #Remote Sensing and LiDAR Applications #Robotics and Sensor-Based Localization #cs.CV #cs.LG #eess.IV #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2010.14599

Accepted by Journal of Intelligent & Robotic Systems (JIRS)

openalex publication_date 2020/10/27 · arxiv created 2020/11/08 · arxiv updated 2020/11/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The paper proposes a light-weighted stereo frustums matching module for 3D objection detection. The proposed framework takes advantage of a high-performance 2D detector and a point cloud segmentation network to regress 3D bounding boxes for autonomous driving vehicles. Instead of performing traditional stereo matching to compute disparities, the module directly takes the 2D proposals from both the left and the right views as input. Based on the epipolar constraints recovered from the well-calibrated stereo cameras, we propose four matching algorithms to search for the best match for each proposal between the stereo image pairs. Each matching pair proposes a segmentation of the scene which is then fed into a 3D bounding box regression network. Results of extensive experiments on KITTI dataset demonstrate that the proposed Siamese pipeline outperforms the state-of-the-art stereo-based 3D bounding box regression methods.

Citations

Related