vix.ing · top · new · best · stats · spec

Mitigating Bias in Facial Recognition Systems: Centroid Fairness Loss Optimization

2025/04/27 by Jean-Rémy Conti, Conti, Jean-Rémy, Stéphan Clémençon +1
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #Emotion and Mood Recognition #FOS: Computer and information sciences #Face recognition and analysis #Machine Learning (cs.LG) #Machine Learning (stat.ML)

paper · pdf · doi:10.48550/arxiv.2504.19370

openalex publication_date 2025/04/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The urging societal demand for fair AI systems has put pressure on the research community to develop predictive models that are not only globally accurate but also meet new fairness criteria, reflecting the lack of disparate mistreatment with respect to sensitive attributes (e.g. gender, ethnicity, age). In particular, the variability of the errors made by certain Facial Recognition (FR) systems across specific segments of the population compromises the deployment of the latter, and was judged unacceptable by regulatory authorities. Designing fair FR systems is a very challenging problem, mainly due to the complex and functional nature of the performance measure used in this domain (i.e. ROC curves) and because of the huge heterogeneity of the face image datasets usually available for training. In this paper, we propose a novel post-processing approach to improve the fairness of pre-trained FR models by optimizing a regression loss which acts on centroid-based scores. Beyond the computational advantages of the method, we present numerical experiments providing strong empirical evidence of the gain in fairness and of the ability to preserve global accuracy.

Citations

Related