An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wild

2020/10/07 by Dresvyanskiy, Denis, Ryumina, Elena, Kaya, Heysem +3
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2010.03692

Abstract

In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer learning approaches, we reached a test set challenge performance measure of 42.10%.

Related

• SUN Team's Contribution to ABAW 2024 Competition: Audio-visual Valence-Arousal Estimation and Expression Recognition
• Investigation of Multimodal Features, Classifiers and Fusion Methods for Emotion Recognition
• Video Multimodal Emotion Recognition System for Real World Applications
• EmoNets: Multimodal deep learning approaches for emotion recognition in\n video
• FV2ES: A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition Inference