Julien Launay

1. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
   2022/11/09 by BigScience Workshop, Workshop, BigScience, Teven Le Scao +784 · 1 voice · 183 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
2. The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only
   2023/06/01 by Guilherme Penedo, Penedo, Guilherme, Quentin Malartic +16 · 2 voices · 90 citations
   Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.AI #cs.CL
3. The Falcon Series of Open Language Models
   2023/11/28 by Ebtesam Almazrouei, Hamza Alobeidli, Almazrouei, Ebtesam +23 · 114 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
4. What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?
   2022/04/12 by Thomas J. Wang, Adam Roberts, Wang, Thomas +13 · 23 citations
   Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
5. What Language Model to Train if You Have One Million GPU Hours?
   2022/10/27 by Teven Le Scao, Thomas J. Wang, Scao, Teven Le +34 · 9 citations
   Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Parallel Computing and Optimization Techniques #Topic Modeling
6. Principled Training of Neural Networks with Direct Feedback Alignment
   2019/06/11 by Julien Launay, Launay, Julien, Iacopo Poli +3 · 5 citations
   Computer Science · Engineering · #Neural Networks and Applications #Advanced Data Processing Techniques #Image Processing and 3D Reconstruction
7. Scaling Laws Beyond Backpropagation
   2022/10/26 by Matthew J. Filipovich, Alessandro Cappelli, Filipovich, Matthew J. +5 · 2 citations
   Computer Science · Neuroscience · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Functional Brain Connectivity Studies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE)
8. Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment
   2020/12/11 by Julien Launay, Launay, Julien, Iacopo Poli +13 · 1 citation
   Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Reservoir Computing #Neural and Evolutionary Computing (cs.NE) #Optical Network Technologies #Photonic and Optical Devices
9. Streamlined optical training of large-scale modern deep learning architectures with direct feedback alignment
   2024/09/01 by Ziao Wang, Wang, Ziao, Kilian Müller +27 · 2 citations
   Computer Science · #Applied Physics (physics.app-ph) #Disordered Systems and Neural Networks (cond-mat.dis-nn) #Emerging Technologies (cs.ET) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Neural Networks and Reservoir Computing #Optics (physics.optics)