vix.ing · top · new · best · stats

Towards More Equitable Question Answering Systems: How Much More Data Do You Need?

2021/05/28 by Arnab Debnath, Debnath, Arnab, Navid Rajabi +5
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL

paper · pdf · doi:10.48550/arxiv.2105.14115

Accepted at ACL 2021

arxiv created 2021/05/28 · openalex publication_date 2021/05/28 · arxiv updated 2021/06/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through translation and cross-lingual transfer. In this project, we take a step back and study which approaches allow us to take the most advantage of existing resources in order to produce QA systems in many languages. Specifically, we perform extensive analysis to measure the efficacy of few-shot approaches augmented with automatic translations and permutations of context-question-answer pairs. In addition, we make suggestions for future dataset development efforts that make better use of a fixed annotation budget, with a goal of increasing the language coverage of QA datasets and systems. Code and data for reproducing our experiments are available here: https://github.com/NavidRajabi/EMQA.

Related