vix.ing · top · new · best · stats · spec

A Multi-Type Multi-Span Network for Reading Comprehension that Requires Discrete Reasoning

2019/08/15 by Minghao Hu, Hu, Minghao, Yuxing Peng +5
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.1908.05514

openalex publication_date 2019/08/15 · openalex created_date 2019/08/22 · openalex updated_date 2026/07/28

Abstract

Rapid progress has been made in the field of reading comprehension and question answering, where several systems have achieved human parity in some simplified settings. However, the performance of these models degrades significantly when they are applied to more realistic scenarios, such as answers involve various types, multiple text strings are correct answers, or discrete reasoning abilities are required. In this paper, we introduce the Multi-Type Multi-Span Network (MTMSN), a neural reading comprehension model that combines a multi-type answer predictor designed to support various answer types (e.g., span, count, negation, and arithmetic expression) with a multi-span extraction method for dynamically producing one or multiple text spans. In addition, an arithmetic expression reranking mechanism is proposed to rank expression candidates for further confirming the prediction. Experiments show that our model achieves 79.9 F1 on the DROP hidden test set, creating new state-of-the-art results. Source code\footnote\urlhttps://github.com/huminghao16/MTMSN is released to facilitate future work.

Citations

Related