Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge

2022/10/22 by Ma, Kaixin, Cheng, Hao, Liu, Xiaodong +2
#Computation and Language (cs.CL) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.2210.12338

Abstract

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the current retriever-reader pipeline. Unlike previous methods that solely rely on the retriever for gathering all evidence in isolation, our intermediary performs a chain of reasoning over the retrieved set. Specifically, our method links the retrieved evidence with its related global context into graphs and organizes them into a candidate list of evidence chains. Built upon pretrained language models, our system achieves competitive performance on two ODQA datasets, OTT-QA and NQ, against tables and passages from Wikipedia. In particular, our model substantially outperforms the previous state-of-the-art on OTT-QA with an exact match score of 47.3 (45 % relative gain).

Related

• Answering Open-Domain Questions of Varying Reasoning Steps from Text
• Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning
• HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
• Open Domain Question Answering with A Unified Knowledge Interface
• UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering