Gur-Ari, Guy
- Solving Quantitative Reasoning Problems with Language Models
2022/06/29 by Aitor Lewkowycz, Anders Andreassen, Lewkowycz, Aitor +25 · 1 voice · 285 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
- PaLM: Scaling Language Modeling with Pathways
2022/04/05 by Aakanksha Chowdhery, Sharan Narang, Chowdhery, Aakanksha +129 · 400 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Show Your Work: Scratchpads for Intermediate Computation with Language Models
2021/11/30 by Maxwell Nye, Anders Andreassen, Nye, Maxwell +22 · 84 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Neural and Evolutionary Computing (cs.NE) #Topic Modeling
- PaLM 2 Technical Report
2023/05/17 by Rohan Anil, Anil, Rohan, Andrew M. Dai +224 · 68 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Gradient Descent Happens in a Tiny Subspace
2018/12/12 by Guy Gur-Ari, Daniel A. Roberts, Gur-Ari, Guy +3 · 36 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Gaussian Processes and Bayesian Inference #Domain Adaptation and Few-Shot Learning
- Exploring Length Generalization in Large Language Models
2022/07/11 by Cem Anil, Yuhuai Wu, Anil, Cem +17 · 20 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- The large learning rate phase of deep learning: the catapult mechanism
2020/03/04 by Aitor Lewkowycz, Lewkowycz, Aitor, Yasaman Bahri +7 · 22 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Domain Adaptation and Few-Shot Learning #Neural Networks and Applications
- Asymptotics of Wide Networks from Feynman Diagrams
2019/09/25 by Dyer, Ethan, Gur-Ari, Guy · 5 citations
#FOS: Computer and information sciences #FOS: Physical sciences #High Energy Physics - Theory (hep-th) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- On the training dynamics of deep networks with L2 regularization
2020/06/15 by Aitor Lewkowycz, Lewkowycz, Aitor, Guy Gur-Ari +1 · 3 citations
Computer Science · Engineering · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Are wider nets better given the same number of parameters?
2020/10/27 by Golubeva, Anna, Neyshabur, Behnam, Gur-Ari, Guy · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)