Shared Task on Evaluating Accuracy in Natural Language Generation

2020/06/22 by Ehud Reiter, Reiter, Ehud, Craig Thomson +1
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2006.12234

openalex publication_date 2020/06/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We propose a shared task on methodologies and algorithms for evaluating the accuracy of generated texts. Participants will measure the accuracy of basketball game summaries produced by NLG systems from basketball box score data.

Related

• A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text\n Systems
• Generation Challenges: Results of the Accuracy Evaluation Shared Task
• Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods
• Human or Machine: Automating Human Likeliness Evaluation of NLG Texts
• Toward Human-Like Evaluation for Natural Language Generation with Error Analysis