Alex Damian
- Fine-Tuning Language Models with Just Forward Passes
2023/05/27 by Sadhika Malladi, Tianyu Gao, Malladi, Sadhika +11 · 1 voice · 44 citations
Computer Science · Engineering · #Ferroelectric and Negative Capacitance Devices #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- How Transformers Learn Causal Structure with Gradient Descent
2024/02/22 by Eshaan Nichani, Nichani, Eshaan, Alex Damian +3 · 23 citations
Computer Science · #Bayesian Modeling and Causal Inference #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability
2022/09/30 by Alex Damian, Eshaan Nichani, Damian, Alex +3 · 9 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Label Noise SGD Provably Prefers Flat Global Minimizers
2021/06/11 by Alex Damian, Damian, Alex, Tengyu Ma +3 · 10 citations
Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Optimization and Control (math.OC)
- Understanding Optimization in Deep Learning with Central Flows
2024/10/31 by Jeremy M. Cohen, Alex Damian, Cohen, Jeremy M. +7 · 7 citations
Decision Sciences · #Simulation Techniques and Applications
- Learning Compositional Functions with Transformers from Easy-to-Hard Data
2025/05/29 by Zixuan Wang, Eshaan Nichani, Wang, Zixuan +11 · 11 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Advanced Graph Neural Networks
- The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Models
2025/06/05 by Alex Damian, Jason D. Lee, Damian, Alex +3 · 2 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Tensor decomposition and applications
- A Defense of the Quadratic Model
2026/07/23 by Alexandru Meterez, Pranav Ajit Nair, Depen Morwani +3
#cs.LG #cs.AI #math.OC #stat.ML