William Fedus
- Emergent Abilities of Large Language Models
2022/06/15 by Jason Wei, Yi Tay, Wei, Jason +30 · 17 voices · 266 citations
Computer Science · #Topic Modeling #Machine Learning and Data Classification #Machine Learning and Algorithms
- Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
2021/01/11 by William Fedus, Fedus, William, Barret Zoph +3 · 9 voices · 501 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.LG
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 138 citations
#cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- Deep Graph Infomax
2018/09/27 by Petar Veličković, William Fedus, Veličković, Petar +10 · 1 voice · 73 citations
Computer Science · Mathematics · Physics and Astronomy · #Advanced Graph Neural Networks #Complex Network Analysis Techniques #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Recommender Systems and Techniques #Social and Information Networks (cs.SI) #cs.IT #cs.LG #cs.SI #stat.ML
- ST-MoE: Designing Stable and Transferable Sparse Expert Models
2022/02/17 by Barret Zoph, Irwan Bello, Zoph, Barret +13 · 1 voice · 52 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Scaling Instruction-Finetuned Language Models
2022/10/20 by Hyung Won Chung, Le Hou, Chung, Hyung Won +62 · 248 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Measuring short-form factuality in large language models
2024/11/07 by Jason Wei, Wei, Jason, Nguyen Karina +13 · 2 voices · 95 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL
- BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
2025/04/16 by J. Wei, Zhiqing Sun, Wei, Jason +16 · 164 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval and Search Behavior #Multimodal Machine Learning Applications #Topic Modeling
- Revisiting Fundamentals of Experience Replay
2020/07/13 by William Fedus, Fedus, William, Prajit Ramachandran +11 · 17 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Age of Information Optimization #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Smart Grid Energy Management
- Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
2022/07/21 by Yi Tay, Tay, Yi, Mostafa Dehghani +17 · 1 voice · 5 citations
Computer Science · Physics and Astronomy · #Complex Network Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Theoretical and Computational Physics #cs.CL #cs.LG
- Language GANs Falling Short
2018/11/06 by Massimo Caccia, Lucas Caccia, William Fedus +3 · 1 voice · 2 citations
#cs.CL #cs.LG
- MaskGAN: Better Text Generation via Filling in the______
2018/01/23 by William Fedus, Ian Goodfellow, Fedus, William +3 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Revisiting ResNets: Improved Training and Scaling Strategies
2021/03/13 by Irwan Bello, Bello, Irwan, William Fedus +13 · 10 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every Step
2017/10/23 by William Fedus, Mihaela Rosca, Fedus, William +9 · 6 citations
Economics, Econometrics and Finance · Energy · #Energy, Environment, and Transportation Policies #FOS: Computer and information sciences #Global Energy and Sustainability Research #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Market Dynamics and Volatility
- On Catastrophic Interference in Atari 2600 Games
2020/02/28 by William Fedus, Fedus, William, Dibya Ghosh +9 · 1 voice
#cs.LG #cs.AI #stat.ML
- Hyperbolic Discounting and Learning over Multiple Horizons
2019/02/19 by William Fedus, Carles Gelada, Fedus, William +7 · 1 voice · 1 citation
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Benchmarking Bonus-Based Exploration Methods on the Arcade Learning\n Environment
2019/08/06 by Adrien Ali Taïga, Taïga, Adrien Ali, William Fedus +7 · 1 citation
Computer Science · Decision Sciences · Psychology · #Advanced Bandit Algorithms Research #Artificial Intelligence in Games #FOS: Computer and information sciences #Gambling Behavior and Treatments #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics