vix.ing · top · new · best · stats · spec

Fedus, William

  1. Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
    2021/01/11 by William Fedus, Fedus, William, Barret Zoph +3 · 9 voices · 493 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.LG
  2. Emergent Abilities of Large Language Models
    2022/06/15 by Jason Wei, Yi Tay, Wei, Jason +30 · 17 voices · 257 citations
    Computer Science · #Topic Modeling #Machine Learning and Data Classification #Machine Learning and Algorithms
  3. Deep Graph Infomax
    2018/09/27 by Petar Veličković, Veličković, Petar, William Fedus +10 · 1 voice · 73 citations
    Computer Science · Mathematics · Physics and Astronomy · #Advanced Graph Neural Networks #Complex Network Analysis Techniques #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Recommender Systems and Techniques #Social and Information Networks (cs.SI) #cs.IT #cs.LG #cs.SI #stat.ML
  4. ST-MoE: Designing Stable and Transferable Sparse Expert Models
    2022/02/17 by Barret Zoph, Irwan Bello, Zoph, Barret +13 · 1 voice · 47 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  5. Scaling Instruction-Finetuned Language Models
    2022/10/20 by Hyung Won Chung, Chung, Hyung Won, Le Hou +62 · 240 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  6. Measuring short-form factuality in large language models
    2024/11/07 by Jason Wei, Nguyen Karina, Wei, Jason +13 · 2 voices · 92 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL
  7. BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
    2025/04/16 by J. Wei, Wei, Jason, Zhiqing Sun +16 · 157 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval and Search Behavior #Multimodal Machine Learning Applications #Topic Modeling
  8. Revisiting Fundamentals of Experience Replay
    2020/07/13 by William Fedus, Fedus, William, Prajit Ramachandran +11 · 16 citations
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Age of Information Optimization #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Smart Grid Energy Management
  9. Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
    2022/07/21 by Yi Tay, Mostafa Dehghani, Tay, Yi +17 · 1 voice · 5 citations
    Computer Science · Physics and Astronomy · #Complex Network Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Theoretical and Computational Physics #cs.CL #cs.LG
  10. Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
    2021/09/22 by Tay, Yi, Dehghani, Mostafa, Rao, Jinfeng +7 · 10 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  11. A Review of Sparse Expert Models in Deep Learning
    2022/09/04 by Fedus, William, Dean, Jeff, Zoph, Barret · 11 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  12. Revisiting ResNets: Improved Training and Scaling Strategies
    2021/03/13 by Irwan Bello, Bello, Irwan, William Fedus +13 · 8 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
  13. Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models
    2023/05/24 by Shen, Sheng, Hou, Le, Zhou, Yanqi +17 · 8 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  14. MaskGAN: Better Text Generation via Filling in the______
    2018/01/23 by William Fedus, Fedus, William, Ian Goodfellow +3 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  15. Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every Step
    2017/10/23 by William Fedus, Fedus, William, Mihaela Rosca +9 · 5 citations
    Economics, Econometrics and Finance · Energy · #Energy, Environment, and Transportation Policies #FOS: Computer and information sciences #Global Energy and Sustainability Research #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Market Dynamics and Volatility
  16. Do Transformer Modifications Transfer Across Implementations and Applications?
    2021/02/23 by Narang, Sharan, Chung, Hyung Won, Tay, Yi +13 · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  17. On Catastrophic Interference in Atari 2600 Games
    2020/02/28 by William Fedus, Fedus, William, Dibya Ghosh +9 · 1 voice
    #cs.LG #cs.AI #stat.ML
  18. Hyperbolic Discounting and Learning over Multiple Horizons
    2019/02/19 by William Fedus, Fedus, William, Carles Gelada +7 · 1 voice · 1 citation
    Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
  19. Disentangling the independently controllable factors of variation by interacting with the world
    2018/02/26 by Thomas, Valentin, Bengio, Emmanuel, Fedus, William +6 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  20. Benchmarking Bonus-Based Exploration Methods on the Arcade Learning\n Environment
    2019/08/06 by Adrien Ali Taïga, William Fedus, Taïga, Adrien Ali +7 · 1 citation
    Computer Science · Decision Sciences · Psychology · #Advanced Bandit Algorithms Research #Artificial Intelligence in Games #FOS: Computer and information sciences #Gambling Behavior and Treatments #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics