vix.ing · top · new · best · stats · spec

Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depth

2019/04/15 by Rui Wang, Wang, Rui, Stephen M. Pizer +3 · 2 citations
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications #Robotics and Sensor-Based Localization

paper · pdf · doi:10.48550/arxiv.1904.07087

openalex publication_date 2019/04/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We propose a learning-based, multi-view dense depth map and odometry estimation method that uses Recurrent Neural Networks (RNN) and trains utilizing multi-view image reprojection and forward-backward flow-consistency losses. Our model can be trained in a supervised or even unsupervised mode. It is designed for depth and visual odometry estimation from video where the input frames are temporally correlated. However, it also generalizes to single-view depth estimation. Our method produces superior results to the state-of-the-art approaches for single-view and multi-view learning-based depth estimation on the KITTI driving dataset.

Citations

Cited by

Related