2022/01/01 by Samir Agarwala, Linyi Jin, Agarwala, Samir +5 · 5 citations
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Robotics and Sensor-Based Localization
paper · pdf · doi:10.48550/arxiv.2208.04307
openalex publication_date 2022/01/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Indoor scenes such as rooms, kitchens and other areas of houses are pre-dominantly composed of planar surfaces. These surfaces may thus be used to generate high-quality scene reconstructions. Previous approaches in this domain are generally optimization-based and use an expensive bundle adjustment step. We propose the PlaneFormer, a transformer-based approach, that takes in 3D-aware plane tokens as inputs and can reconstruct scenes using planar surfaces. Our experiments show that our method outperforms baselines on most metrics, can be extended reasonably to multiple views and requires several 3D-specific choices to perform effectively on the task.