Benoît Sagot
- Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
2021/03/22 by Julia Kreutzer, Isaac Caswell, Lisa Wang +55 · 2 voices · 6 citations
Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.AI #cs.CL
- Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP
2021/12/20 by Sabrina J. Mielke, Zaid Alyafeai, Mielke, Sabrina J. +19 · 2 voices · 19 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Machine Learning in Bioinformatics #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck
2024/04/11 by Nathan Godey, Éric Villemonte de la Clergerie, Godey, Nathan +4 · 2 voices · 6 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL
- ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification\n Models with Multiple Rewriting Transformations
2020/05/01 by Fernando Alva-Manchego, Alva-Manchego, Fernando, Louis Martin +9 · 11 citations
Computer Science · #Text Readability and Simplification #Natural Language Processing Techniques
- CamemBERT: a Tasty French Language Model
2020/01/01 by Louis Martin, Benjamin Müller, Pedro Ortiz Suárez +5 · 1 voice · 13 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Web Data Mining and Analysis
- Anisotropy Is Inherent to Self-Attention in Transformers
2024/01/22 by Nathan Godey, Eric Villemonte de La Clergerie, Godey, Nathan +4 · 2 voices · 8 citations
Computer Science · #cs.CL
- Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question\n Answering
2020/10/23 by Arij Riabi, Riabi, Arij, Thomas Scialom +9 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Generative Spoken Language Model based on continuous word-sized audio tokens
2023/10/08 by Robin Algayres, Yossi Adi, Algayres, Robin +11 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing #Speech Recognition and Synthesis #Speech and Audio Processing
- From Text to Source: Results in Detecting Large Language Model-Generated Content
2023/09/23 by Wissam Antoun, Antoun, Wissam, Benoît Sagot +3 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques #Topic Modeling
- ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance
2025/04/11 by Wissam Antoun, Benoît Sagot, Antoun, Wissam +3 · 2 voices · 2 citations
Computer Science · Engineering · Decision Sciences · #Sensor Technology and Measurement Systems #Advanced Electrical Measurement Techniques #Scientific Measurement and Uncertainty Evaluation
- Can Multilingual Language Models Transfer to an Unseen Dialect? A Case\n Study on North African Arabizi
2020/05/01 by Benjamin Müller, Benoît Sagot, Muller, Benjamin +3 · 1 citation
Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language, Linguistics, Cultural Analysis #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Rethinking Automatic Evaluation in Sentence Simplification
2021/04/15 by Thomas Scialom, Scialom, Thomas, Louis Martin +7 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon
2022/06/22 by Robin Algayres, Algayres, Robin, Tristan Ricoul +13 · 1 citation
Computer Science · #Speech Recognition and Synthesis #Natural Language Processing Techniques #Topic Modeling
- Evaluating the reliability of acoustic speech embeddings
2020/07/27 by Robin Algayres, Mohamed Salah Zaïem, Algayres, Robin +5 · 1 citation
Computer Science · Psychology · #Speech Recognition and Synthesis #Phonetics and Phonology Research #Topic Modeling
- Headless Language Models: Learning without Predicting with Contrastive Weight Tying
2023/09/15 by Nathan Godey, Éric Villemonte de la Clergerie, Godey, Nathan +4 · 4 voices · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translation
2024/08/01 by Armel Randy Zebaze, Zebaze, Armel, Benoît Sagot +3 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- On the Scaling Laws of Geographical Representation in Language Models
2024/02/29 by Nathan Godey, Godey, Nathan, Eric Villemonte de La Clergerie +3 · 1 citation
Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Geographic Information Systems Studies #Human Mobility and Location-Based Analysis #Language and cultural evolution
- Towards Zero-Shot Multimodal Machine Translation
2024/07/18 by Matthieu Futeral, Futeral, Matthieu, Cordelia Schmid +5 · 1 citation
Computer Science · #Natural Language Processing Techniques #Multimodal Machine Learning Applications #Topic Modeling
- CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data
2026/01/25 by Pedro Ortiz Suarez, Laurie Burchell, Catherine Arnett +94 · 2 voices · 1 citation
#cs.CL
- Gaperon: A Peppered English-French Generative Language Model Suite
2025/10/29 by Nathan Godey, Wissam Antoun, Godey, Nathan +11 · 4 voices
#cs.CL #cs.AI