Findings of the IWSLT 2024 Evaluation Campaign

2024/11/07 by Ibrahim Said Ahmad, Ahmad, Ibrahim Said, Antonios Anastasopoulos +87 · 6 citations
Computer Science · Engineering · #Advanced Data Processing Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #GNSS positioning and interference #Seismology and Earthquake Studies

paper · pdf · doi:10.48550/arxiv.2411.05088

openalex publication_date 2024/11/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper reports on the shared tasks organized by the 21st IWSLT Conference. The shared tasks address 7 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling and dubbing, speech-to-speech translation, dialect and low-resource speech translation, and Indic languages. The shared tasks attracted 18 teams whose submissions are documented in 26 system papers. The growing interest towards spoken language translation is also witnessed by the constantly increasing number of shared task organizers and contributors to the overview paper, almost evenly distributed across industry and academia.

Cited by

• Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMs
• Re-evaluating Minimum Bayes Risk Decoding for Automatic Speech Recognition
• End-to-end Automatic Speech Recognition and Speech Translation: Integration of Speech Foundational Models and LLMs
• The Unheard Alternative: Contrastive Explanations for Speech-to-Text Models
• Better Late Than Never: Meta-Evaluation of Latency Metrics for Simultaneous Speech-to-Text Translation
• Human + AI for Accelerating Ad Localization Evaluation

Related

• FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task
• KIT's Multilingual Speech Translation System for IWSLT 2023
• NAVER LABS Europe's Multilingual Speech Translation Systems for the IWSLT 2023 Low-Resource Track
• IMS' Systems for the IWSLT 2021 Low-Resource Speech Translation Task
• The HW-TSC's Offline Speech Translation Systems for IWSLT 2021 Evaluation