Azalia Mirhoseini
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Sparsely-Gated MoE layers increase model capacity by over 1000x with minimal compute loss, improving language modeling and translation.
2017/01/23 by Noam Shazeer, Shazeer, Noam, Azalia Mirhoseini +13 · 11 voices · 663 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Topic Modeling #cs.CL #cs.LG #cs.NE #stat.ML
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Eric Bieber, Comanici, Gheorghe +6844 · 8 voices · 1362 citations
#cs.CL #cs.AI
- Affective Coherence Monitoring for Transformer-Based Language Models
2022/12/15 by Yuntao Bai, Bai, Yuntao, Saurav Kadavath +102 · 12 voices · 448 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #cs.AI #cs.CL
- Large Language Monkeys: Scaling Inference Compute with Repeated Sampling
2024/07/31 by Bradley Brown, Brown, Bradley, Jordan Juravsky +11 · 2 voices · 164 citations
Computer Science · #cs.LG #cs.AI
- Training of Physical Neural Networks
2024/06/05 by Ali Momeni, Babak Rahmani, Momeni, Ali +53 · 4 voices · 28 citations
#physics.app-ph #cs.LG
- Chip Placement with Deep Reinforcement Learning
2020/04/22 by Azalia Mirhoseini, Anna Goldie, Mirhoseini, Azalia +41 · 4 voices · 5 citations
#cs.LG #cs.AI
- LLM-as-a-Verifier: A General-Purpose Verification Framework
2026/07/06 by Jacky Kwok, Shulu Li, Pranav Atreya +6 · 6 voices
#cs.AI #cs.CL #cs.LG #cs.MA #cs.RO
- That Chip Has Sailed: A Critique of Unfounded Skepticism Around AI for Chip Design
2024/11/15 by Anna Goldie, Azalia Mirhoseini, Goldie, Anna +3 · 2 voices · 2 citations
Computer Science · Social Sciences · #Computability, Logic, AI Algorithms #Ethics and Social Impacts of AI #cs.AI #cs.LG
- The Capacity for Moral Self-Correction in Large Language Models
2023/02/15 by Deep Ganguli, Amanda Askell, Ganguli, Deep +100 · 1 voice · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling #cs.CL
- Measuring Progress on Scalable Oversight for Large Language Models
2022/11/04 by Samuel R. Bowman, Bowman, Samuel R., Jeeyoon Hyun +88 · 21 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Multi-Agent Systems and Negotiation #Speech and dialogue systems #Topic Modeling
- KernelBench: Can LLMs Write Efficient GPU Kernels?
2025/02/14 by Anne Ouyang, Ouyang, Anne, Simon Guo +11 · 44 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Machine Learning (cs.LG) #Machine Learning and Data Classification #Performance (cs.PF) #Software Engineering (cs.SE)
- Device Placement Optimization with Reinforcement Learning
2017/06/13 by Azalia Mirhoseini, Hieu Pham, Mirhoseini, Azalia +17 · 13 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Reinforcement Learning in Robotics
- Archon: An Architecture Search Framework for Inference-Time Techniques
2024/09/23 by Jon Saad-Falcon, Saad-Falcon, Jon, Lafuente, Adrian Gamarra +17 · 12 citations
Computer Science · #Advanced Database Systems and Queries #Semantic Web and Ontologies
- Hydragen: High-Throughput LLM Inference with Shared Prefixes
2024/02/07 by Jordan Juravsky, Juravsky, Jordan, Bradley Brown +9 · 8 citations
Computer Science · #Natural Language Processing Techniques #Mathematics, Computing, and Information Processing
- Cartridges: Lightweight and general-purpose long context representations via self-study
2025/06/06 by Sabri Eyuboglu, Ryan Ehrlich, Eyuboglu, Sabri +18 · 18 citations
Computer Science · Social Sciences · #Topic Modeling #Natural Language Processing Techniques #Computational and Text Analysis Methods
- CodeMonkeys: Scaling Test-Time Compute for Software Engineering
2025/01/24 by Ryan Ehrlich, Bradley Brown, Ehrlich, Ryan +9 · 12 citations
Computer Science · Decision Sciences · #Embedded Systems Design Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Scientific Computing and Data Management #Software Testing and Debugging Techniques
- Intelligence per Watt: Measuring Intelligence Efficiency of Local AI
2025/11/11 by Jon Saad-Falcon, Avanika Narayan, Saad-Falcon, Jon +27 · 7 voices · 4 citations
#cs.DC #cs.AI #cs.CL #cs.LG
- CATS: Contextually-Aware Thresholding for Sparsity in Large Language Models
2024/04/12 by Je-Yong Lee, Lee, Donghyun, Lee, Je-Yong +6 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Specific versus General Principles for Constitutional AI
2023/10/20 by Sandipan Kundu, Yuntao Bai, Kundu, Sandipan +69 · 4 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences
- How Do Large Language Monkeys Get Their Power (Laws)?
2025/02/24 by Rylan Schaeffer, Schaeffer, Rylan, Joshua Kazdan +14 · 10 citations
Social Sciences · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Language and cultural evolution #Machine Learning (cs.LG)
- Astra: A Multi-Agent System for GPU Kernel Performance Optimization
2025/09/09 by Anjiang Wei, Wei, Anjiang, Yogesh Seenichamy +12 · 11 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Software Engineering (cs.SE) #and Cluster Computing (cs.DC)
- Exploring Diffusion Transformer Designs via Grafting
2025/06/05 by Keshigeyan Chandrasegaran, Michael Poli, Chandrasegaran, Keshigeyan +21 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Software Engineering Research #Software Testing and Debugging Techniques
- Think, Prune, Train, Improve: Scaling Reasoning without Scaling Models
2025/04/25 by Caia Costello, Costello, Caia, Simon Guo +5 · 2 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling