Phrase-Indexed Question Answering: A New Challenge for Scalable Document Comprehension

2018/04/20 by Seo, Minjoon, Kwiatkowski, Tom, Parikh, Ankur P. +2
#Computation and Language (cs.CL) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.1804.07726

Abstract

We formalize a new modular variant of current question answering tasks by enforcing complete independence of the document encoder from the question encoder. This formulation addresses a key challenge in machine comprehension by requiring a standalone representation of the document discourse. It additionally leads to a significant scalability advantage since the encoding of the answer candidate phrases in the document can be pre-computed and indexed offline for efficient retrieval. We experiment with baseline models for the new task, which achieve a reasonable accuracy but significantly underperform unconstrained QA models. We invite the QA research community to engage in Phrase-Indexed Question Answering (PIQA, pika) for closing the gap. The leaderboard is at: nlp.cs.washington.edu/piqa

Related

• EfficientQA : a RoBERTa Based Phrase-Indexed Question-Answering System
• Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index
• A Joint Model for Question Answering and Question Generation
• EEE-QA: Exploring Effective and Efficient Question-Answer Representations
• Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answering