vix.ing · top · new · best · stats · spec

FastViDAR: Real-Time Omnidirectional Depth Estimation via Alternative Hierarchical Attention

2025/09/28 by Hangtian Zhao, Xiang Chen, Zhao, Hangtian +9
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Optical measurement and interference techniques #Robotics (cs.RO) #Robotics and Sensor-Based Localization

paper · pdf · doi:10.48550/arxiv.2509.23733

openalex publication_date 2025/09/28 · openalex created_date 2025/10/19 · openalex updated_date 2026/07/28

Abstract

In this paper we propose FastViDAR, a novel framework that takes four fisheye camera inputs and produces a full 360^∘ depth map along with per-camera depth, fusion depth, and confidence estimates. Our main contributions are: (1) We introduce Alternative Hierarchical Attention (AHA) mechanism that efficiently fuses features across views through separate intra-frame and inter-frame windowed self-attention, achieving cross-view feature mixing with reduced overhead. (2) We propose a novel ERP fusion approach that projects multi-view depth estimates to a shared equirectangular coordinate system to obtain the final fusion depth. (3) We generate ERP image-depth pairs using HM3D and 2D3D-S datasets for comprehensive evaluation, demonstrating competitive zero-shot performance on real datasets while achieving up to 20 FPS on NVIDIA Orin NX embedded hardware. Project page: \hrefhttps://3f7dfc.github.io/FastVidar/https://3f7dfc.github.io/FastVidar/

Citations

Related