Emotional Musical Prosody: Validated Vocal Dataset for Human Robot Interaction

2020/10/09 by Richard Savery, Savery, Richard, Lisa Zahray +3
Computer Science · Engineering · Psychology · #AI in Service Interactions #FOS: Computer and information sciences #Robot Manipulation and Learning #Robotics (cs.RO) #Social Robot Interaction and HRI

paper · pdf · doi:10.48550/arxiv.2010.04839

openalex publication_date 2020/10/09 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Human collaboration with robotics is dependant on the development of a relationship between human and robot, without which performance and utilization can decrease. Emotion and personality conveyance has been shown to enhance robotic collaborations, with improved human-robot relationships and increased trust. One under-explored way for an artificial agent to convey emotions is through non-linguistic musical prosody. In this work we present a new 4.2 hour dataset of improvised emotional vocal phrases based on the Geneva Emotion Wheel. This dataset has been validated through extensive listening tests and shows promising preliminary results for use in generative systems.

Related

• Emotional Musical Prosody for the Enhancement of Trust in Robotic Arm Communication
• Prosody for Intuitive Robotic Interface Design: It's Not What You Said, It's How You Said It
• Disambiguating Affective Stimulus Associations for Robot Perception and Dialogue
• Emotional Speech Synthesis for Companion Robot to Imitate Professional Caregiver Speech
• Musical Prosody-Driven Emotion Classification: Interpreting Vocalists Portrayal of Emotions Through Machine Learning