Can spoofing countermeasure and speaker verification systems be jointly optimised?

2023/03/13 by Ge, Wanying, Tak, Hemlata, Todisco, Massimiliano +1
#Audio and Speech Processing (eess.AS) #FOS: Electrical engineering #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2303.07073

Abstract

Spoofing countermeasure (CM) and automatic speaker verification (ASV) sub-systems can be used in tandem with a backend classifier as a solution to the spoofing aware speaker verification (SASV) task. The two sub-systems are typically trained independently to solve different tasks. While our previous work demonstrated the potential of joint optimisation, it also showed a tendency to over-fit to speakers and a lack of sub-system complementarity. Using only a modest quantity of auxiliary data collected from new speakers, we show that joint optimisation degrades the performance of separate CM and ASV sub-systems, but that it nonetheless improves complementarity, thereby delivering superior SASV performance. Using standard SASV evaluation data and protocols, joint optimisation reduces the equal error rate by 27% relative to performance obtained using fixed, independently-optimised sub-systems under like-for-like training conditions.

Related

• On the potential of jointly-optimised solutions to spoofing attack detection and automatic speaker verification
• Joint Optimization of Speaker and Spoof Detectors for Spoofing-Robust Automatic Speaker Verification
• SA-SASV: An End-to-End Spoof-Aggregated Spoofing-Aware Speaker Verification System
• Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion
• A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification