Naman Goyal
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
2020/05/22 by Patrick Lewis, Ethan Perez, Lewis, Patrick +21 · 10 voices · 1602 citations
#cs.CL #cs.LG
- OPT: Open Pre-trained Transformer Language Models
2022/05/02 by Susan Zhang, Zhang, Susan, Stephen Roller +35 · 2 voices · 266 citations
#cs.CL #cs.LG
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1374 citations
#cs.CL #cs.AI
- LLaMA: Open and Efficient Foundation Language Models
2023/02/27 by Hugo Touvron, Thibaut Lavril, Touvron, Hugo +25 · 1719 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- Llama 2: Open Foundation and Fine-Tuned Chat Models
2023/07/18 by Hugo Touvron, Touvron, Hugo, Louis Martin +133 · 1357 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech and dialogue systems
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language\n Generation, Translation, and Comprehension
2019/10/29 by Yinhan Liu, Lewis, Mike, Liu, Yinhan +12 · 262 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Efficient Large Scale Language Modeling with Mixtures of Experts
2021/12/20 by Mikel Artetxe, Shruti Bhosale, Artetxe, Mikel +47 · 1 voice · 16 citations
Computer Science · #Topic Modeling #Expert finding and Q&A systems #Machine Learning in Healthcare
- XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
2021/11/17 by Arun Babu, Babu, Arun, Changhan Wang +23 · 77 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Multilingual Denoising Pre-training for Neural Machine Translation
2020/01/22 by Yinhan Liu, Jiatao Gu, Liu, Yinhan +13 · 76 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation
2021/06/06 by Naman Goyal, Goyal, Naman, Cynthia Gao +17 · 55 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- A Theory on Adam Instability in Large-Scale Machine Learning
2023/04/19 by Igor Molybog, Molybog, Igor, Peter Albert +33 · 1 voice · 3 citations
Computer Science · #Computational Physics and Python Applications #Neural Networks and Applications #Topic Modeling #cs.AI #cs.LG #math.OC
- Beyond English-Centric Multilingual Machine Translation
2020/10/21 by Angela Fan, Fan, Angela, Shruti Bhosale +31 · 34 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- BASE Layers: Simplifying Training of Large, Sparse Models
2021/03/30 by Mike Lewis, Shruti Bhosale, Lewis, Mike +7 · 34 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Algorithms
- Text-To-4D Dynamic Scene Generation
2023/01/26 by Uriel Singer, Shelly Sheynin, Singer, Uriel +19 · 34 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Human Motion and Animation #Machine Learning (cs.LG) #Video Analysis and Summarization
- Multilingual Translation with Extensible Multilingual Pretraining and Finetuning
2020/08/02 by Yuqing Tang, Chau Tran, Tang, Yuqing +13 · 16 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Scaling Laws for Generative Mixed-Modal Language Models
2023/01/10 by Armen Aghajanyan, Lili Yu, Aghajanyan, Armen +17 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Few-shot Learning with Multilingual Language Models
2021/12/20 by Xi Victoria Lin, Lin, Xi Victoria, Todor Mihaylov +39 · 11 citations
Computer Science · #Topic Modeling #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques
- XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
2023/01/25 by Davis Liang, Hila Gonen, Liang, Davis +13 · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Lifting the Curse of Multilinguality by Pre-training Modular Transformers
2022/05/12 by Jonas Pfeiffer, Naman Goyal, Pfeiffer, Jonas +11 · 4 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training?
2022/04/29 by Shiyue Zhang, Vishrav Chaudhary, Zhang, Shiyue +11 · 3 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- Multilingual Autoregressive Entity Linking
2021/03/23 by Nicola De Cao, Ledell Wu, De Cao, Nicola +17 · 1 citation
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- The Social Dynamics of Language Change in Online Networks
2016/09/07 by Rahul Goel, Goel, Rahul, Sandeep Soni +11 · 1 citation
Social Sciences · Computer Science · #Linguistic Variation and Morphology #Authorship Attribution and Profiling #Language and cultural evolution