The Voice Experience Inventory (VOXI): Validating a consensus-driven instrument for measuring user impressions of computer voice

2025/07/16 by Katie Seaborn, Maximilian Altmeyer, Ge Li +3 · 2 voices
Computer Science · Psychology · #Speech and dialogue systems #AI in Service Interactions #Social Robot Interaction and HRI

paper · doi:10.1016/j.ijhcs.2025.103576

openalex publication_date 2025/07/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/22

Abstract

Voice interaction has entered daily life. Yet, the measurement of voice user experience (voice UX) remains underdeveloped. We took a consensus-based approach to the creation of a new instrument grounded in the work of voice UX researchers. For this, we conducted a systemic review of the literature from ACM, IEEE, and Web of Science ( ) to gather a corpus of instruments, measures, and methodological perspectives. We then carried out two validation studies on a range of computer voices, showing through exploratory ( ) and confirmatory factor analyses ( ) that five underlying factors unify the consensus-derived measures. We offer the 24-item Voice Experience Inventory (VOXI) alongside three comprehensive frameworks on key independent and dependent variables and their relationships, anchored to the material that guided our instrument development process. This work represents a timely and community-centred path towards rigorous and standardized measurement of voice UX.

Citations

• A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method
• An Empirical Evaluation of the System Usability Scale
• Little Jiffy, Mark Iv
• The weirdest people in the world?
• A Rationale and Test for the Number of Factors in Factor Analysis
• Developmental sequence in small groups.
• The Advantages and Limitations of Using Meta-analysis in Human Resource Management Research
• Psychological, Relational, and Emotional Effects of Self-Disclosure After Conversations With a Chatbot
• Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences
• The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
• Factor Analysis as a Tool for Survey Analysis
• Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
• The Partner Modelling Questionnaire: A validated self-report measure of perceptions toward machines as dialogue partners
• Cross-Cultural Validation of Partner Models for Voice User Interfaces
• The Partner Modelling Questionnaire: A Validated Self-Report Measure of Perceptions toward Machines as Dialogue Partners
• The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
• The Usability Metric for User Experience
• Instructional manipulation checks: Detecting satisficing to increase statistical power

Discussions

• The VOXI (Voice Experience Inventory) is now published #openaccess! 📣 doi.org/10.1016/j.ij... The VOXI is a community-driven, validated instrument for measuring impressions of computer voice. Check [bsky, 0 points, 0 comments]
• Elated to share that the VOXI (Voice Experience Inventory) is now published # openaccess and ready for action in # hci # hri # hai # haii and beyond! 📣 https:// doi.org/10.1016/j.ijhcs.2025.1 03576 T [mastodon, 0 points, 0 comments]