vix.ing · top · new · best · stats · spec

Carmon, Yair

  1. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
    2022/03/10 by Mitchell Wortsman, Gabriel Ilharco, Wortsman, Mitchell +19 · 3 voices · 163 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification #cs.CL #cs.CV #cs.LG
  2. DataComp-LM: In search of the next generation of training sets for language models
    2024/06/17 by Jeffrey Li, Alex Chengyu Fang, Li, Jeffrey +121 · 2 voices · 80 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
  3. DataComp: In search of the next generation of multimodal datasets
    2023/04/27 by Samir Yitzhak Gadre, Gabriel Ilharco, Gadre, Samir Yitzhak +65 · 79 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
  4. Lower Bounds for Non-Convex Stochastic Optimization
    2019/12/05 by Yossi Arjevani, Yair Carmon, Arjevani, Yossi +9 · 27 citations
    Computer Science · Mathematics · Engineering · #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods #Sparse and Compressive Sensing Techniques
  5. Lower Bounds for Finding Stationary Points I
    2017/10/31 by Carmon, Yair, Duchi, John C., Hinder, Oliver +1 · 21 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  6. Unlabeled Data Improves Adversarial Robustness
    2019/05/31 by Yair Carmon, Carmon, Yair, Aditi Raghunathan +7 · 19 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
  7. No bad local minima: Data independent training error guarantees for\n multilayer neural networks
    2016/05/26 by Daniel Soudry, Yair Carmon, Soudry, Daniel +1 · 21 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Stochastic Gradient Optimization Techniques
  8. Accuracy on the Line: On the Strong Correlation Between\n Out-of-Distribution and In-Distribution Generalization
    2021/07/09 by J. J. Miller, Rohan Taori, Miller, John +15 · 15 citations
    Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
  9. "Convex Until Proven Guilty": Dimension-Free Acceleration of Gradient\n Descent on Non-Convex Functions
    2017/05/08 by Yair Carmon, Oliver Hinder, Carmon, Yair +5 · 15 citations
    Medicine · Engineering · #Bone and Joint Diseases #Sparse and Compressive Sensing Techniques #Glioma Diagnosis and Treatment
  10. DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
    2023/02/08 by Maor Ivgi, Ivgi, Maor, Oliver Hinder +3 · 17 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
  11. Lower Bounds for Finding Stationary Points II: First-Order Methods
    2017/11/02 by Carmon, Yair, Duchi, John C., Hinder, Oliver +1 · 9 citations
    #FOS: Mathematics #Optimization and Control (math.OC)
  12. Large-Scale Methods for Distributionally Robust Optimization
    2020/10/12 by Daniel Lévy, Levy, Daniel, Yair Carmon +5 · 9 citations
    Business, Management and Accounting · Decision Sciences · Engineering · #Advanced Control Systems Optimization #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Risk and Portfolio Optimization #Supply Chain and Inventory Management
  13. Second-Order Information in Non-Convex Stochastic Optimization: Power and Limitations
    2020/06/24 by Arjevani, Yossi, Carmon, Yair, Duchi, John C. +3 · 8 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  14. Resolving Discrepancies in Compute-Optimal Scaling of Language Models
    2024/06/27 by Tomer Porian, Mitchell Wortsman, Porian, Tomer +7 · 16 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
  15. Optimal and Adaptive Monteiro-Svaiter Acceleration
    2022/05/30 by Yair Carmon, Danielle Hausler, Carmon, Yair +7 · 8 citations
    Mathematics · Engineering · Computer Science · #Advanced Optimization Algorithms Research #Sparse and Compressive Sensing Techniques #Matrix Theory and Algorithms
  16. Language models scale reliably with over-training and on downstream tasks
    2024/03/13 by Samir Yitzhak Gadre, Gadre, Samir Yitzhak, Georgios Smyrnis +45 · 12 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  17. Making SGD Parameter-Free
    2022/05/04 by Yair Carmon, Oliver Hinder, Carmon, Yair +1 · 7 citations
    Computer Science · Decision Sciences · Engineering · #Stochastic Gradient Optimization Techniques #Advanced Bandit Algorithms Research #Sparse and Compressive Sensing Techniques
  18. Variance Reduction for Matrix Games
    2019/07/03 by Carmon, Yair, Jin, Yujia, Sidford, Aaron +1 · 4 citations
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  19. Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments
    2022/02/13 by Maor Ivgi, Yair Carmon, Ivgi, Maor +3 · 4 citations
    Computer Science · Materials Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning in Materials Science #Natural Language Processing Techniques #Numerical Analysis (math.NA) #Topic Modeling
  20. Acceleration with a Ball Optimization Oracle
    2020/03/18 by Carmon, Yair, Jambulapati, Arun, Jiang, Qijia +4 · 3 citations
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Optimization and Control (math.OC)
  21. ReSQueing Parallel and Private Stochastic Convex Optimization
    2023/01/01 by Yair Carmon, Arun Jambulapati, Carmon, Yair +11 · 4 citations
    Computer Science · Engineering · Mathematics · #Cryptography and Security (cs.CR) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  22. Accelerated Parameter-Free Stochastic Optimization
    2024/03/31 by Itai Kreisler, Maor Ivgi, Kreisler, Itai +5 · 5 citations
    Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Neural Networks and Applications #Optimization and Control (math.OC)
  23. Stochastic Bias-Reduced Gradient Methods
    2021/06/17 by Hilal Asi, Yair Carmon, Asi, Hilal +7 · 3 citations
    Computer Science · Engineering · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  24. RECAPP: Crafting a More Efficient Catalyst for Convex Optimization
    2022/06/17 by Carmon, Yair, Jambulapati, Arun, Jin, Yujia +1 · 2 citations
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  25. The Price of Adaptivity in Stochastic Convex Optimization
    2024/02/16 by Carmon, Yair, Hinder, Oliver · 3 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  26. Thinking Inside the Ball: Near-Optimal Minimization of the Maximal Loss
    2021/05/04 by Yair Carmon, Arun Jambulapati, Carmon, Yair +5 · 2 citations
    Computer Science · Decision Sciences · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Probability and Risk Models #Risk and Portfolio Optimization #Stochastic Gradient Optimization Techniques
  27. A Rank-1 Sketch for Matrix Multiplicative Weights
    2019/03/07 by Carmon, Yair, Duchi, John C., Sidford, Aaron +1 · 1 citation
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  28. Accelerated Methods for Non-Convex Optimization
    2016/11/02 by Yair Carmon, Carmon, Yair, John C. Duchi +5 · 2 citations
    Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  29. Coordinate Methods for Matrix Games
    2020/09/17 by Yair Carmon, Carmon, Yair, Yujia Jin +5 · 2 citations
    Computer Science · Decision Sciences · Mathematics · #Stochastic Gradient Optimization Techniques #Advanced Bandit Algorithms Research #Markov Chains and Monte Carlo Methods
  30. Distributionally Robust Optimization via Ball Oracle Acceleration
    2022/03/24 by Carmon, Yair, Hausler, Danielle · 1 citation
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
  31. Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond
    2023/05/22 by Itai Kreisler, Kreisler, Itai, Mor Shpigel Nacson +5 · 1 citation
    Computer Science · #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  32. Malign Overfitting: Interpolation Can Provably Preclude Invariance
    2022/11/28 by Yoav Wald, Wald, Yoav, Gal Yona +5 · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
  33. A Whole New Ball Game: A Primal Accelerated Method for Matrix Games and Minimizing the Maximum of Smooth Functions
    2023/11/17 by Yair Carmon, Arun Jambulapati, Carmon, Yair +5 · 1 citation
    Computer Science · Decision Sciences · Mathematics · #Advanced Bandit Algorithms Research #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
  34. Filter Like You Test: Data-Driven Data Filtering for CLIP Pretraining
    2025/03/11 by Shechter, Mikey, Carmon, Yair · 1 citation
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  35. Convergence of Clipped SGD on Convex (L0,L1)-Smooth Functions
    2025/02/23 by Gaash, Ofir, Levy, Kfir Yehuda, Carmon, Yair · 1 citation
    #FOS: Mathematics #Optimization and Control (math.OC)