Eran Malach
- Proving the Lottery Ticket Hypothesis: Pruning is All You Need
2020/02/03 by Eran Malach, Gilad Yehudai, Malach, Eran +6 · 2 voices · 21 citations
Computer Science · Materials Science · #Machine Learning and Algorithms #Machine Learning in Materials Science #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- Transcendence: Generative Models Can Outperform The Experts That Train Them
2024/06/17 by Edwin Zhang, Vincent Zhu, Zhang, Edwin +13 · 8 voices · 9 citations
#cs.LG #cs.AI
- Auto-Regressive Next-Token Predictors are Universal Learners
2023/09/13 by Eran Malach, Malach, Eran · 2 voices · 13 citations
Computer Science · #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit
2022/07/18 by Boaz Barak, Barak, Boaz, Benjamin Edelman +11 · 1 voice · 15 citations
Computer Science · Materials Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning in Materials Science #Neural and Evolutionary Computing (cs.NE) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques #cs.LG #cs.NE #math.OC #stat.ML
- Repeat After Me: Transformers are Better than State Space Models at Copying
2024/02/01 by Samy Jelassi, Jelassi, Samy, David Brandfonbrener +5 · 39 citations
Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Scientific Computing and Data Management #Simulation Techniques and Applications
- The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains
2024/02/16 by Benjamin Edelman, Ezra Edelman, Edelman, Benjamin L. +7 · 27 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- Mixture of Parrots: Experts improve memorization more than reasoning
2024/10/24 by Samy Jelassi, Jelassi, Samy, Clara Mohri +17 · 2 voices · 8 citations
Agricultural and Biological Sciences · Psychology · #Animal Behavior and Reproduction #Primate Behavior and Ecology
- Decoupling "when to update" from "how to update"
2017/06/08 by Eran Malach, Shai Shalev‐Shwartz, Malach, Eran +1 · 7 citations
Computer Science · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification
- LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
2024/10/16 by Akshara Prabhakar, Yuanzhi Li, Prabhakar, Akshara +9 · 14 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Robotics and Automated Systems
- A New Perspective on Shampoo's Preconditioner
2024/06/25 by Depen Morwani, Morwani, Depen, Itai Shapira +9 · 11 citations
Engineering · #Acoustic Wave Phenomena Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Vibration Control and Rheological Fluids
- On the Power of Differentiable Learning versus PAC and SQ Learning
2021/08/09 by Emmanuel Abbé, Abbe, Emmanuel, Pritish Kamath +7 · 4 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Markov Chains and Monte Carlo Methods #Stochastic Gradient Optimization Techniques
- Universal Length Generalization with Turing Programs
2024/07/03 by Kaiying Hou, David Brandfonbrener, Hou, Kaiying +7 · 6 citations
Computer Science · #Computability, Logic, AI Algorithms #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Don't Stop Me Now: Embedding Based Scheduling for LLMs
2024/10/01 by Rana Shahout, Eran Malach, Shahout, Rana +9 · 5 citations
Engineering · Computer Science · #Scheduling and Optimization Algorithms #Distributed and Parallel Computing Systems
- Quantifying the Benefit of Using Differentiable Learning over Tangent Kernels
2021/03/01 by Eran Malach, Malach, Eran, Pritish Kamath +5 · 3 citations
Computer Science · #Anomaly Detection Techniques and Applications #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications
- Loss-to-Loss Prediction: Scaling Laws for All Datasets
2024/11/19 by David Brandfonbrener, Nikhil Anand, Brandfonbrener, David +7 · 5 citations
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Healthcare #Statistical Methods and Inference
- Computational Separation Between Convolutional and Fully-Connected Networks
2020/10/03 by Eran Malach, Shai Shalev‐Shwartz, Malach, Eran +1 · 3 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques
- Pareto Frontiers in Neural Feature Learning: Data, Compute, Width, and Luck
2023/09/07 by Benjamin Edelman, Edelman, Benjamin L., Surbhi Goel +7 · 2 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Neural Networks and Applications #Machine Learning and Algorithms
- Decomposing Elements of Problem Solving: What "Math" Does RL Teach?
2025/05/28 by Tian Qin, C. Park, Qin, Tian +12 · 5 citations
Computer Science · Mathematics · Psychology · #Artificial Intelligence (cs.AI) #Cognitive and developmental aspects of mathematical skills #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Teaching and Learning Programming #Visual and Cognitive Learning Processes
- To Backtrack or Not to Backtrack: When Sequential Search Limits Model Reasoning
2025/04/09 by Tian Qin, David Alvarez-Melis, Qin, Tian +5 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- SGD Learns Over-parameterized Networks that Provably Generalize on\n Linearly Separable Data
2017/10/27 by Alon Brutzkus, Brutzkus, Alon, Amir Globerson +5 · 2 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Model Reduction and Neural Networks #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Less is More: Selective Layer Finetuning with SubTuning
2023/02/13 by Gal Kaplun, Andrey Gurevich, Kaplun, Gal +9 · 1 citation
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- Let Me Think! A Long Chain-of-Thought Can Be Worth Exponentially Many Short Ones
2025/05/27 by Parsa Mirtaheri, Mirtaheri, Parsa, Ezra Edelman +7 · 4 citations
Computer Science · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- A Taxonomy of Transcendence
2025/08/25 by Natalie Abreu, Edwin Zhang, Abreu, Natalie +5 · 3 voices · 2 citations
#cs.AI