vix.ing · top · new · best · stats · spec

A Novel Framework for Assessment of Learning-based Detectors in Realistic Conditions with Application to Deepfake Detection

2022/03/22 by Yuhang Lu, Lu, Yuhang, Ruizhi Luo +3
Computer Science · #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #Digital Media Forensic Detection #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Signal Denoising Methods #Image and Video Processing (eess.IV) #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2203.11797

openalex publication_date 2022/03/22 · openalex created_date 2022/04/03 · openalex updated_date 2026/07/28

Abstract

Deep convolutional neural networks have shown remarkable results on multiple detection tasks. Despite the significant progress, the performance of such detectors are often assessed in public benchmarks under non-realistic conditions. Specifically, impact of conventional distortions and processing operations such as compression, noise, and enhancement are not sufficiently studied. This paper proposes a rigorous framework to assess performance of learning-based detectors in more realistic situations. An illustrative example is shown under deepfake detection context. Inspired by the assessment results, a data augmentation strategy based on natural image degradation process is designed, which significantly improves the generalization ability of two deepfake detectors.

Related