vix.ing · top · new · best · stats

Automatic Content-aware Projection for 360° Videos

2017/04/25 by Yeong Won Kim, Dae-Yong Jo, Kim, Yeong Won +11
Computer Science · Engineering · #Advanced Optical Imaging Technologies #Advanced Vision and Imaging #FOS: Computer and information sciences #Graphics (cs.GR) #Image and Video Quality Assessment #Image and Video Stabilization #Visual Attention and Saliency Detection #cs.GR

paper · pdf · doi:10.48550/arxiv.1704.07528

Accepted to International Conference on Computer Vision (ICCV), 2017

openalex publication_date 2017/04/25 · arxiv created 2017/09/10 · arxiv updated 2017/09/12 · openalex created_date 2022/09/19 · openalex updated_date 2026/07/28

Abstract

To watch 360° videos on normal 2D displays, we need to project the selected part of the 360° image onto the 2D display plane. In this paper, we propose a fully-automated framework for generating content-aware 2D normal-view perspective videos from 360° videos. Especially, we focus on the projection step preserving important image contents and reducing image distortion. Basically, our projection method is based on Pannini projection model. At first, the salient contents such as linear structures and salient regions in the image are preserved by optimizing the single Panini projection model. Then, the multiple Panini projection models at salient regions are interpolated to suppress image distortion globally. Finally, the temporal consistency for image projection is enforced for producing temporally stable normal-view videos. Our proposed projection method does not require any user-interaction and is much faster than previous content-preserving methods. It can be applied to not only images but also videos taking the temporal consistency of projection into account. Experiments on various 360° videos show the superiority of the proposed projection method quantitatively and qualitatively.

Related