Going Retro: Astonishingly Simple Yet Effective Rule-based Prosody Modelling for Speech Synthesis Simulating Emotion Dimensions

2023/07/05 by Burkhardt, Felix, Reichel, Uwe, Eyben, Florian +1 · 1 citation
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2307.02132

Abstract

We introduce two rule-based models to modify the prosody of speech synthesis in order to modulate the emotion to be expressed. The prosody modulation is based on speech synthesis markup language (SSML) and can be used with any commercial speech synthesizer. The models as well as the optimization result are evaluated against human emotion annotations. Results indicate that with a very simple method both dimensions arousal (.76 UAR) and valence (.43 UAR) can be simulated.

Cited by

• Improving French Synthetic Speech Quality via SSML Prosody Control

Related

• PROEMO: Prompt-Driven Text-to-Speech Synthesis Based on Emotion and Intensity Control
• Time out of Mind: Generating Rate of Speech conditioned on emotion and speaker
• Fine-grained Emotion Strength Transfer, Control and Prediction for Emotional Speech Synthesis
• MsEmoTTS: Multi-scale emotion transfer, prediction, and control for emotional speech synthesis
• Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotions