Jeff Dean
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Sparsely-Gated MoE layers increase model capacity by over 1000x with minimal compute loss, improving language modeling and translation.
2017/01/23 by Noam Shazeer, Shazeer, Noam, Azalia Mirhoseini +13 · 11 voices · 879 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling #cs.CL #cs.LG #cs.NE #stat.ML
- Emergent Abilities of Large Language Models
2022/06/15 by Jason Wei, Wei, Jason, Yi Tay +30 · 17 voices · 398 citations
Computer Science · #Topic Modeling #Machine Learning and Data Classification #Machine Learning and Algorithms
- Carbon Emissions and Large Neural Network Training
2021/04/21 by David Patterson, Patterson, David, Joseph Gonzalez +15 · 11 voices · 97 citations
Computer Science · #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.CY #cs.LG
- Distilling the Knowledge in a Neural Network
2015/03/09 by Geoffrey Hinton, Geoffrey E. Hinton, Hinton, Geoffrey +5 · 5 voices · 2170 citations
Computer Science · #Neural Networks and Applications #Time Series Analysis and Forecasting #Topic Modeling #cs.LG #cs.NE #stat.ML
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
2024/03/08 by Gemini Robotics Team, Gemini Team, Petko Georgiev +2277 · 4 voices · 941 citations
Computer Science · #Semantic Web and Ontologies
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1398 citations
#cs.CL #cs.AI
- Scalable and accurate deep learning with electronic health records
2018/01/24 by Alvin Rajkomar, Eyal Oren, Kai Chen +35 · 2 voices · 58 citations
Computer Science · Health Professions · Medicine · #Machine Learning in Healthcare #Electronic Health Records Systems #Artificial Intelligence in Healthcare and Education
- Efficient Neural Architecture Search via Parameter Sharing
2018/02/09 by Hieu Pham, Melody Y. Guan, Pham, Hieu +7 · 2 voices · 183 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #cs.CL #cs.CV #cs.LG #cs.NE #stat.ML
- Chip Placement with Deep Reinforcement Learning
2020/04/22 by Azalia Mirhoseini, Mirhoseini, Azalia, Anna Goldie +50 · 4 voices · 14 citations
Engineering · #3D IC and TSV technologies #Modular Robots and Swarm Intelligence #VLSI and FPGA Design Techniques #cs.AI #cs.LG
- Scaling Instruction-Finetuned Language Models
2022/10/20 by Hyung Won Chung, Chung, Hyung Won, Le Hou +72 · 1 voice · 376 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL #cs.LG
- Matryoshka Quantization
2025/02/10 by Pranav Nair, Nair, Pranav, Puranjay Datta +7 · 7 voices · 4 citations
Physics and Astronomy · Engineering · #Optical and Acousto-Optic Technologies #Advanced Control and Stabilization in Aerospace Systems
- Distributed Representations of Words and Phrases and their Compositionality
2013/10/16 by Tomáš Mikolov, Ilya Sutskever, Mikolov, Tomas +7 · 455 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- PaLM: Scaling Language Modeling with Pathways
2022/04/05 by Aakanksha Chowdhery, Sharan Narang, Chowdhery, Aakanksha +129 · 610 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- ST-MoE: Designing Stable and Transferable Sparse Expert Models
2022/02/17 by Barret Zoph, Irwan Bello, Zoph, Barret +13 · 1 voice · 77 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Gemma 3 Technical Report
2025/03/25 by Gemma Team, Aishwarya Kamath, Johan Ferret +418 · 3 voices · 594 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
- Building high-level features using large scale unsupervised learning
2011/12/29 by Quoc V. Le, Marc’Aurelio Ranzato, Marc'Aurelio Ranzato +14 · 1 voice · 31 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Face recognition and analysis #Machine Learning (cs.LG) #cs.LG
- Gemma: Open Models Based on Gemini Research and Technology
2024/03/13 by Gemma Team, Thomas Mésnard, Cassidy Hardin +203 · 220 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation
- Efficiently Scaling Transformer Inference
2022/11/09 by Reiner Pope, Pope, Reiner, Sholto Douglas +17 · 112 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Topic Modeling
- Capabilities of Gemini Models in Medicine
2024/04/29 by Khaled Saab, Tao Tu, Saab, Khaled +138 · 3 voices · 50 citations
Computer Science · Decision Sciences · Mathematics · #Mathematical Biology Tumor Growth #Simulation Techniques and Applications #cs.AI #cs.CL #cs.CV #cs.LG
- A Review of Sparse Expert Models in Deep Learning
2022/09/04 by William Fedus, Fedus, William, Jeff Dean +3 · 1 voice · 20 citations
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.CL #cs.LG
- The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
2022/04/11 by David A. Patterson, Joseph E. Gonzalez, Patterson, David +17 · 45 citations
Engineering · Environmental Science · #Air Quality Monitoring and Forecasting #Artificial Intelligence (cs.AI) #Environmental Impact and Sustainability #FOS: Computer and information sciences #General Literature (cs.GL) #Green IT and Sustainability #Machine Learning (cs.LG)
- That Chip Has Sailed: A Critique of Unfounded Skepticism Around AI for Chip Design
2024/11/15 by Anna Goldie, Goldie, Anna, Azalia Mirhoseini +3 · 2 voices · 2 citations
Computer Science · Social Sciences · #Computability, Logic, AI Algorithms #Ethics and Social Impacts of AI #cs.AI #cs.LG
- Device Placement Optimization with Reinforcement Learning
2017/06/13 by Azalia Mirhoseini, Hieu Pham, Mirhoseini, Azalia +17 · 22 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics
- The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
2022/06/28 by David S. Patterson, David Patterson, Joseph Gonzalez +13 · 15 citations
Computer Science · #Explainable Artificial Intelligence (XAI)
- Dynamic Control Flow in Large-Scale Machine Learning
2018/05/04 by Yuan Yu, Martín Abadi, Paul Barham +12 · 1 voice · 1 citation
Computer Science · #cs.DC #cs.LG
- Measuring the environmental impact of delivering AI at Google Scale
2025/08/21 by Cooper Elsworth, Elsworth, Cooper, Keguo Huang +23 · 7 voices · 9 citations
Engineering · Social Sciences · Computer Science · #Green IT and Sustainability #Ethics and Social Impacts of AI #IoT and Edge/Fog Computing
- Pathways: Asynchronous Distributed Dataflow for ML
2022/03/23 by Paul Barham, Barham, Paul, Aakanksha Chowdhery +29 · 4 citations
Computer Science · #Advanced Data Storage Technologies #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Brainformers: Trading Simplicity for Efficiency
2023/05/29 by Yanqi Zhou, Nan Du, Zhou, Yanqi +26 · 4 citations
Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Shaping AI's Impact on Billions of Lives
2024/12/03 by Mariano-Florentino Cuéllar, Jeff Dean, Cuéllar, Mariano-Florentino +16 · 6 voices · 1 citation
Computer Science · Social Sciences · #Ethics and Social Impacts of AI #cs.AI #cs.CY #cs.ET #cs.LG
- Interlocking Backpropagation: Improving depthwise model-parallelism
2020/10/08 by Aidan N. Gomez, Oscar Key, Gomez, Aidan N. +10 · 1 citation
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- AI and the Opportunity for Shared Prosperity: Lessons from the History of Technology and the Economy
2024/01/18 by Guy Ben-Ishai, Ben-Ishai, Guy, Jeff Dean +10 · 1 voice
Economics, Econometrics and Finance · #Economic Development and Digital Transformation #Economic Growth and Productivity #Economic and Technological Innovation #FOS: Economics and business #General Economics (econ.GN) #econ.GN
- Decoupled DiLoCo for Resilient Distributed Pre-training
2026/04/23 by Arthur Douillard, Keith Rush, Yani Donchev +14 · 1 voice
Computer Science · #cs.CL
- WAXAL: A Large-Scale Multilingual African Language Speech Corpus
2026/02/02 by Abdoulaye Diack, Perry Nelson, Kwaku Agbesi +40 · 1 voice · 1 citation
#eess.AS #cs.AI #cs.CL