vix.ing · top · new · best · stats · spec

Grounding Dialogue Systems via Knowledge Graph Aware Decoding with\n Pre-trained Transformers

2021/03/30 by Debanjan Chaudhuri, Chaudhuri, Debanjan, Md Rashad Al Hasan Rony +3 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2103.16289

openalex publication_date 2021/03/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Generating knowledge grounded responses in both goal and non-goal oriented\ndialogue systems is an important research challenge. Knowledge Graphs (KG) can\nbe viewed as an abstraction of the real world, which can potentially facilitate\na dialogue system to produce knowledge grounded responses. However, integrating\nKGs into the dialogue generation process in an end-to-end manner is a\nnon-trivial task. This paper proposes a novel architecture for integrating KGs\ninto the response generation process by training a BERT model that learns to\nanswer using the elements of the KG (entities and relations) in a multi-task,\nend-to-end setting. The k-hop subgraph of the KG is incorporated into the model\nduring training and inference using Graph Laplacian. Empirical evaluation\nsuggests that the model achieves better knowledge groundedness (measured via\nEntity F1 score) compared to other state-of-the-art models for both goal and\nnon-goal oriented dialogues.\n

Cited by

Related