User Evaluation of a Multi-dimensional Statistical Dialogue System

2019/09/06 by Keizer, Simon, Dušek, Ondřej, Liu, Xingkun +1
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.1909.02965

Abstract

We present the first complete spoken dialogue system driven by a multi-dimensional statistical dialogue manager. This framework has been shown to substantially reduce data needs by leveraging domain-independent dimensions, such as social obligations or feedback, which (as we show) can be transferred between domains. In this paper, we conduct a user study and show that the performance of a multi-dimensional system, which can be adapted from a source domain, is equivalent to that of a one-dimensional baseline, which can only be trained from scratch.

Related

• Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems
• Towards Learning Transferable Conversational Skills using Multi-dimensional Dialogue Modelling
• Achieving Reliable Human Assessment of Open-Domain Dialogue Systems
• Towards Efficient Dialogue Pre-training with Transferable and Interpretable Latent Structure
• Improving Dialogue Management: Quality Datasets vs Models