vix.ing · top · new · best · stats · spec

Zeyuan Allen-Zhu

  1. LoRA: Low-Rank Adaptation of Large Language Models
    2021/06/17 by Edward J. Hu, J. Edward Hu, Hu, Edward J. +14 · 10 voices · 2084 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  2. A Convergence Theory for Deep Learning via Over-Parameterization
    2018/11/09 by Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan, Yuanzhi Li +3 · 120 citations
    Computer Science · Physics and Astronomy · #Reinforcement Learning in Robotics #Model Reduction and Neural Networks #Evolutionary Algorithms and Applications
  3. Physics of Language Models: Part 3.1, Knowledge Storage and Extraction
    2023/09/25 by Zeyuan Allen Zhu, Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan +2 · 4 voices · 48 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
  4. Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws
    2024/04/08 by Zeyuan Allen-Zhu, Yuanzhi Li, Allen-Zhu, Zeyuan +1 · 2 voices · 16 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
  5. Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning
    2020/12/17 by Zeyuan Allen-Zhu, Yuanzhi Li, Allen-Zhu, Zeyuan +1 · 25 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Optimization and Control (math.OC)
  6. Physics of Language Models: Part 1, Learning Hierarchical Language Structures
    2023/05/23 by Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan, Yuanzhi Li +1 · 17 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
  7. Physics of Language Models: Part 3.2, Knowledge Manipulation
    2023/09/25 by Zeyuan Allen-Zhu, Yuanzhi Li, Allen-Zhu, Zeyuan +1 · 16 citations
    Computer Science · #Topic Modeling #Machine Learning and Algorithms #Explainable Artificial Intelligence (XAI)
  8. Neon2: Finding Local Minima via First-Order Oracles
    2017/11/17 by Zeyuan Allen-Zhu, Yuanzhi Li, Allen-Zhu, Zeyuan +1 · 10 citations
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Complexity and Algorithms in Graphs
  9. What Can ResNet Learn Efficiently, Going Beyond Kernels?
    2019/05/24 by Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan, Yuanzhi Li +1 · 8 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Data Structures and Algorithms (cs.DS) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Optimization and Control (math.OC)
  10. Byzantine Stochastic Gradient Descent
    2018/03/23 by Dan Alistarh, Alistarh, Dan, Zeyuan Allen-Zhu +3 · 5 citations
    Computer Science · Mathematics · #Data Structures and Algorithms (cs.DS) #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  11. Byzantine-Resilient Non-Convex Stochastic Gradient Descent
    2020/12/28 by Zeyuan Allen-Zhu, Faeze Ebrahimian, Allen-Zhu, Zeyuan +5 · 5 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Adversarial Robustness in Machine Learning
  12. Near-Optimal Discrete Optimization for Experimental Design: A Regret Minimization Approach
    2017/11/14 by Zeyuan Allen-Zhu, Yuanzhi Li, Allen-Zhu, Zeyuan +5 · 3 citations
    Computer Science · Engineering · #Computation (stat.CO) #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Sparse and Compressive Sensing Techniques
  13. Reverse Training to Nurse the Reversal Curse
    2024/03/20 by Olga Golovneva, Golovneva, Olga, Zeyuan Allen-Zhu +5 · 7 citations
    Psychology · #Aging and Gerontology Research #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  14. Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems
    2024/08/29 by Ye Tian, Ye, Tian, Zicheng Xu +5 · 9 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
  15. Near-optimal discrete optimization for experimental design: a regret minimization approach
    2020/01/10 by Zeyuan Allen-Zhu, Yuanzhi Li, Aarti Singh +1 · 4 citations
    Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Machine Learning and Algorithms
  16. First Efficient Convergence for Streaming k-PCA: a Global, Gap-Free, and Near-Optimal Rate
    2016/07/26 by Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan, Yuanzhi Li +1 · 3 citations
    Computer Science · Engineering · Mathematics · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Numerical Analysis (math.NA) #Optimization and Control (math.OC) #Random Matrices and Applications #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  17. Backward Feature Correction: How Deep Learning Performs Deep (Hierarchical) Learning
    2020/01/13 by Zeyuan Allen-Zhu, Yuanzhi Li, Allen-Zhu, Zeyuan +1 · 2 citations
    Computer Science · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Neural Networks and Applications #Neural and Evolutionary Computing (cs.NE) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  18. Improved SVRG for Non-Strongly-Convex or Sum-of-Non-Convex Objectives
    2015/06/05 by Zeyuan Allen-Zhu, Yuan Yang, Allen-Zhu, Zeyuan +1 · 1 citation
    Computer Science · Engineering · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  19. LazySVD: Even Faster SVD Decomposition Yet Without Agonizing Pain
    2016/07/12 by Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan, Yuanzhi Li +1 · 1 citation
    Computer Science · Engineering · #Blind Source Separation Techniques #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Numerical Analysis (math.NA) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  20. Follow the Compressed Leader: Faster Online Learning of Eigenvectors and Faster MMWU
    2017/01/06 by Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan, Yuanzhi Li +1 · 1 citation
    Computer Science · Decision Sciences · #Stochastic Gradient Optimization Techniques #Advanced Bandit Algorithms Research #Optimization and Search Problems
  21. Doubly Accelerated Methods for Faster CCA and Generalized Eigendecomposition
    2016/07/20 by Zeyuan Allen-Zhu, Allen-Zhu, Zeyuan, Yuanzhi Li +1 · 1 citation
    Computer Science · Engineering · Neuroscience · #Blind Source Separation Techniques #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Face and Expression Recognition #Functional Brain Connectivity Studies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
  22. SALSA VERDE: a machine learning attack on Learning With Errors with sparse small secrets
    2023/06/20 by Yue Li, Li, Cathy Yuanchen, Emily Wenger +7 · 1 citation
    Computer Science · #Cryptography and Data Security #Coding theory and cryptography #Cryptography and Residue Arithmetic