vix.ing · top · new · best · stats · spec

Vec2Face: Unveil Human Faces from their Blackbox Features in Face\n Recognition

2020/03/15 by Chi Nhan Duong, Duong, Chi Nhan, Thanh-Dat Truong +9 · 3 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face and Expression Recognition #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis

paper · pdf · doi:10.48550/arxiv.2003.06958

openalex publication_date 2020/03/15 · openalex created_date 2022/07/26 · openalex updated_date 2026/07/28

Abstract

Unveiling face images of a subject given his/her high-level representations\nextracted from a blackbox Face Recognition engine is extremely challenging. It\nis because the limitations of accessible information from that engine including\nits structure and uninterpretable extracted features. This paper presents a\nnovel generative structure with Bijective Metric Learning, namely Bijective\nGenerative Adversarial Networks in a Distillation framework (DiBiGAN), for\nsynthesizing faces of an identity given that person's features. In order to\neffectively address this problem, this work firstly introduces a bijective\nmetric so that the distance measurement and metric learning process can be\ndirectly adopted in image domain for an image reconstruction task. Secondly, a\ndistillation process is introduced to maximize the information exploited from\nthe blackbox face recognition engine. Then a Feature-Conditional Generator\nStructure with Exponential Weighting Strategy is presented for a more robust\ngenerator that can synthesize realistic faces with ID preservation. Results on\nseveral benchmarking datasets including CelebA, LFW, AgeDB, CFP-FP against\nmatching engines have demonstrated the effectiveness of DiBiGAN on both image\nrealism and ID preservation properties.\n

Cited by

Related