vix.ing · top · new · best · stats · spec

Dense Light Field Reconstruction From Sparse Sampling Using Residual Network

2018/06/14 by Mantang Guo, Hao Zhu, Guo, Mantang +5
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Enhancement Techniques #Optical Coherence Tomography Applications #cs.CV

paper · pdf · doi:10.48550/arxiv.1806.05506

openalex publication_date 2018/06/14 · arxiv created 2018/08/11 · arxiv updated 2018/08/14 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

A light field records numerous light rays from a real-world scene. However, capturing a dense light field by existing devices is a time-consuming process. Besides, reconstructing a large amount of light rays equivalent to multiple light fields using sparse sampling arises a severe challenge for existing methods. In this paper, we present a learning based method to reconstruct multiple novel light fields between two mutually independent light fields. We indicate that light rays distributed in different light fields have the same consistent constraints under a certain condition. The most significant constraint is a depth related correlation between angular and spatial dimensions. Our method avoids working out the error-sensitive constraint by employing a deep neural network. We solve residual values of pixels on epipolar plane image (EPI) to reconstruct novel light fields. Our method is able to reconstruct 2 to 4 novel light fields between two mutually independent input light fields. We also compare our results with those yielded by a number of alternatives elsewhere in the literature, which shows our reconstructed light fields have better structure similarity and occlusion relationship.

Related