vix.ing · top · new · best · stats

Content Adaptive and Error Propagation Aware Deep Video Compression

2020/03/25 by Guo Lu, Lu, Guo, Chunlei Cai +11 · 13 citations
Computer Science · Engineering · #Advanced Data Compression Techniques #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Video Coding and Compression Technologies #cs.CV #eess.IV #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2003.11282

First two authors contributed equally

arxiv created 2020/03/25 · openalex publication_date 2020/03/25 · arxiv updated 2020/03/26 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Recently, learning based video compression methods attract increasing attention. However, the previous works suffer from error propagation due to the accumulation of reconstructed error in inter predictive coding. Meanwhile, the previous learning based video codecs are also not adaptive to different video contents. To address these two problems, we propose a content adaptive and error propagation aware video compression system. Specifically, our method employs a joint training strategy by considering the compression performance of multiple consecutive frames instead of a single frame. Based on the learned long-term temporal information, our approach effectively alleviates error propagation in reconstructed frames. More importantly, instead of using the hand-crafted coding modes in the traditional compression systems, we design an online encoder updating scheme in our system. The proposed approach updates the parameters for encoder according to the rate-distortion criterion but keeps the decoder unchanged in the inference stage. Therefore, the encoder is adaptive to different video contents and achieves better compression performance by reducing the domain gap between the training and testing datasets. Our method is simple yet effective and outperforms the state-of-the-art learning based video codecs on benchmark datasets without increasing the model size or decreasing the decoding speed.

Citations

Cited by

Related