vix.ing · top · new · best · stats

Loss Function Search for Face Recognition

2020/07/10 by Xiaobo Wang, Wang, Xiaobo, Shuo Wang +7 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Face and Expression Recognition #Face recognition and analysis #cs.CV

paper · pdf · doi:10.48550/arxiv.2007.06542

Accepted by ICML2020. arXiv admin note: substantial text overlap with arXiv:1912.00833; text overlap with arXiv:1905.07375 by other authors

arxiv created 2020/07/10 · openalex publication_date 2020/07/10 · arxiv updated 2020/07/14 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In face recognition, designing margin-based (e.g., angular, additive, additive angular margins) softmax loss functions plays an important role in learning discriminative features. However, these hand-crafted heuristic methods are sub-optimal because they require much effort to explore the large design space. Recently, an AutoML for loss function search method AM-LFS has been derived, which leverages reinforcement learning to search loss functions during the training process. But its search space is complex and unstable that hindering its superiority. In this paper, we first analyze that the key to enhance the feature discrimination is actually how to reduce the softmax probability. We then design a unified formulation for the current margin-based softmax losses. Accordingly, we define a novel search space and develop a reward-guided search method to automatically obtain the best candidate. Experimental results on a variety of face recognition benchmarks have demonstrated the effectiveness of our method over the state-of-the-art alternatives.

Citations

Cited by

Related