2023/03/16 by Jun Yu, Yu, Jun, Jichao Zhu +11
Computer Science · Psychology · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Emotion and Mood Recognition #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Sleep and Work-Related Fatigue
paper · pdf · doi:10.48550/arxiv.2303.09210
openalex publication_date 2023/03/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth Affective Behavior Analysis in-the-wild(ABAW), a dual-branch based multi-output regression model. The spatial attention is used to better extract visual features, and the Mel-Frequency Cepstral Coefficients technology extracts acoustic features, and a method named modality dropout is added to fusion multimodal features. Our method achieves excellent results on the official validation set.