vix.ing · top · new · best · stats · spec

Hierarchical Dialogue Understanding with Special Tokens and Turn-level Attention

2023/04/29 by Xiao Liu, Jian Zhang, Liu, Xiao +7
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Speech and dialogue systems #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2305.00262

openalex publication_date 2023/04/29 · openalex created_date 2023/05/03 · openalex updated_date 2026/07/28

Abstract

Compared with standard text, understanding dialogue is more challenging for machines as the dynamic and unexpected semantic changes in each turn. To model such inconsistent semantics, we propose a simple but effective Hierarchical Dialogue Understanding model, HiDialog. Specifically, we first insert multiple special tokens into a dialogue and propose the turn-level attention to learn turn embeddings hierarchically. Then, a heterogeneous graph module is leveraged to polish the learned embeddings. We evaluate our model on various dialogue understanding tasks including dialogue relation extraction, dialogue emotion recognition, and dialogue act classification. Results show that our simple approach achieves state-of-the-art performance on all three tasks above. All our source code is publicly available at https://github.com/ShawX825/HiDialog.

Related