Sagot, Benoît
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
2022/11/09 by Workshop, BigScience, :, Scao, Teven Le +391 · 110 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP
2021/12/20 by Sabrina J. Mielke, Zaid Alyafeai, Mielke, Sabrina J. +19 · 2 voices · 19 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Machine Learning in Bioinformatics #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck
2024/04/11 by Nathan Godey, Godey, Nathan, Éric de la Clergerie +4 · 2 voices · 6 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL
- When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models
2020/10/24 by Muller, Benjamin, Anastasopoulos, Antonis, Sagot, Benoît +1 · 13 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification\n Models with Multiple Rewriting Transformations
2020/05/01 by Fernando Alva-Manchego, Alva-Manchego, Fernando, Louis Martin +9 · 11 citations
Computer Science · #Text Readability and Simplification #Natural Language Processing Techniques
- SONAR: Sentence-Level Multimodal and Language-Agnostic Representations
2023/08/22 by Duquenne, Paul-Ambroise, Schwenk, Holger, Sagot, Benoît · 18 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Towards a Cleaner Document-Oriented Multilingual Crawled Corpus
2022/01/17 by Abadji, Julien, Suarez, Pedro Ortiz, Romary, Laurent +1 · 12 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Anisotropy Is Inherent to Self-Attention in Transformers
2024/01/22 by Nathan Godey, Eric Villemonte de La Clergerie, Éric de la Clergerie +4 · 2 voices · 8 citations
Computer Science · #cs.CL
- Controllable Sentence Simplification
2019/10/07 by Martin, Louis, Sagot, Benoît, de la Clergerie, Éric +1 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question\n Answering
2020/10/23 by Arij Riabi, Thomas Scialom, Riabi, Arij +9 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Headless Language Models: Learning without Predicting with Contrastive Weight Tying
2023/09/15 by Nathan Godey, Éric Villemonte de la Clergerie, Godey, Nathan +4 · 4 voices · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT
2021/01/26 by Muller, Benjamin, Elazar, Yanai, Sagot, Benoît +1 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- From Text to Source: Results in Detecting Large Language Model-Generated Content
2023/09/23 by Wissam Antoun, Benoît Sagot, Antoun, Wissam +3 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques #Topic Modeling
- ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance
2025/04/11 by Wissam Antoun, Antoun, Wissam, Benoît Sagot +3 · 2 voices · 2 citations
Computer Science · Engineering · Decision Sciences · #Sensor Technology and Measurement Systems #Advanced Electrical Measurement Techniques #Scientific Measurement and Uncertainty Evaluation
- CamemBERT 2.0: A Smarter French Language Model Aged to Perfection
2024/11/13 by Antoun, Wissam, Kulumba, Francis, Touchent, Rian +3 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon
2022/06/22 by Robin Algayres, Algayres, Robin, Tristan Ricoul +13 · 2 citations
Computer Science · #Speech Recognition and Synthesis #Natural Language Processing Techniques #Topic Modeling
- Towards a Robust Detection of Language Model Generated Text: Is ChatGPT that Easy to Detect?
2023/06/09 by Antoun, Wissam, Mouilleron, Virginie, Sagot, Benoît +1 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- mOSCAR: A Large-scale Multilingual and Multimodal Document-level Corpus
2024/06/13 by Futeral, Matthieu, Zebaze, Armel, Suarez, Pedro Ortiz +5 · 2 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Rethinking Automatic Evaluation in Sentence Simplification
2021/04/15 by Thomas Scialom, Scialom, Thomas, Louis Martin +7 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- UniMorph 4.0: Universal Morphology
2022/05/07 by Batsuren, Khuyagbaatar, Goldman, Omer, Khalifa, Salam +93 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations
2022/11/08 by Duquenne, Paul-Ambroise, Gong, Hongyu, Dong, Ning +7 · 1 citation
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translation
2024/08/01 by Armel Randy Zebaze, Zebaze, Armel, Benoît Sagot +3 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Q-Filters: Leveraging QK Geometry for Efficient KV Cache Compression
2025/03/04 by Godey, Nathan, Devoto, Alessio, Zhao, Yu +4 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- On the Scaling Laws of Geographical Representation in Language Models
2024/02/29 by Nathan Godey, Godey, Nathan, Eric Villemonte de La Clergerie +3 · 1 citation
Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Geographic Information Systems Studies #Human Mobility and Location-Based Analysis #Language and cultural evolution
- Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translation
2025/03/06 by Zebaze, Armel, Sagot, Benoît, Bawden, Rachel · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Towards Zero-Shot Multimodal Machine Translation
2024/07/18 by Matthieu Futeral, Cordelia Schmid, Futeral, Matthieu +5 · 1 citation
Computer Science · #Natural Language Processing Techniques #Multimodal Machine Learning Applications #Topic Modeling
- Gaperon: A Peppered English-French Generative Language Model Suite
2025/10/29 by Nathan Godey, Godey, Nathan, Wissam Antoun +11 · 4 voices
#cs.CL #cs.AI