vix.ing · top · new · best · stats · spec

Kale, Satyen

  1. On the Convergence of Adam and Beyond
    2019/04/19 by Reddi, Sashank J., Kale, Satyen, Kumar, Sanjiv · 91 citations
    #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  2. Estimating Training Data Influence by Tracing Gradient Descent
    2020/02/19 by Garima Pruthi, Frederick Liu, Pruthi, Garima +5 · 87 citations
    Business, Management and Accounting · Decision Sciences · #AI and HR Technologies #Scheduling and Timetabling Solutions
  3. Taming the Monster: A Fast and Simple Algorithm for Contextual Bandits
    2014/02/04 by Alekh Agarwal, Agarwal, Alekh, Daniel Hsu +9 · 63 citations
    Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Data Stream Mining Techniques
  4. Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch
    2025/01/30 by Arthur Douillard, Douillard, Arthur, Yanislav Donchev +26 · 7 voices · 7 citations
    Computer Science · Social Sciences · #Multimedia Communication and Technology #Semantic Web and Ontologies #cs.CL
  5. SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
    2019/10/14 by Sai Praneeth Karimireddy, Satyen Kale, Karimireddy, Sai Praneeth +9 · 28 citations
    Computer Science · #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Cryptography and Data Security
  6. A Field Guide to Federated Optimization
    2021/07/14 by Jianyu Wang, Wang, Jianyu, Zachary Charles +103 · 17 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
  7. Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
    2020/08/08 by Karimireddy, Sai Praneeth, Jaggi, Martin, Kale, Satyen +4 · 8 citations
    #68W15 #68W40 #90C06 #90C25 #Distributed #E.4 #F.2.1 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
  8. Asynchronous Local-SGD Training for Language Modeling
    2024/01/17 by Bo Liu, Rachita Chhaparia, Liu, Bo +13 · 2 voices · 4 citations
    #cs.LG #cs.CL
  9. Contextual Bandit Learning with Predictable Rewards
    2012/02/07 by Alekh Agarwal, Miroslav Dudı́k, Agarwal, Alekh +7 · 5 citations
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Smart Grid Energy Management
  10. Online Gradient Boosting
    2015/06/16 by Alina Beygelzimer, Elad Hazan, Beygelzimer, Alina +5 · 5 citations
    Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Sparse and Compressive Sensing Techniques
  11. Projection-free Online Learning
    2012/06/18 by Hazan, Elad, Kale, Satyen · 3 citations
    #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  12. Efficient and Practical Stochastic Subgradient Descent for Nuclear Norm Regularization
    2012/06/27 by Haim Avron, Avron, Haim, Satyen Kale +5 · 4 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Matrix Theory and Algorithms #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  13. Learning with User-Level Privacy
    2021/02/23 by Levy, Daniel, Sun, Ziteng, Amin, Kareem +4 · 4 citations
    #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
  14. Parameter-free online learning via model selection
    2017/12/30 by Foster, Dylan J., Kale, Satyen, Mohri, Mehryar +1 · 3 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  15. Hypothesis Set Stability and Generalization
    2019/04/09 by Foster, Dylan J., Greenberg, Spencer, Kale, Satyen +3 · 3 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  16. Efficient Optimal Learning for Contextual Bandits
    2011/06/13 by Dudik, Miroslav, Hsu, Daniel, Kale, Satyen +4 · 2 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  17. Reproducibility in Optimization: Theoretical Framework and Limits
    2022/02/09 by Kwangjun Ahn, Prateek Jain, Ahn, Kwangjun +9 · 3 citations
    Computer Science · Engineering · Decision Sciences · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Advanced Bandit Algorithms Research
  18. Logistic Regression: The Importance of Being Improper
    2018/03/25 by Foster, Dylan J., Kale, Satyen, Luo, Haipeng +2 · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  19. Escaping Saddle Points with Adaptive Gradient Methods
    2019/01/26 by Matthew Staib, Sashank J. Reddi, Staib, Matthew +7 · 2 citations
    Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
  20. On the Convergence of Federated Averaging with Cyclic Client Participation
    2023/02/06 by Yae Jee Cho, Pranay Sharma, Cho, Yae Jee +9 · 3 citations
    Computer Science · #Cooperative Communication and Network Coding #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Wireless Networks and Protocols #and Cluster Computing (cs.DC)
  21. A Deep Conditioning Treatment of Neural Networks
    2020/02/04 by Agarwal, Naman, Awasthi, Pranjal, Kale, Satyen · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  22. Multiarmed Bandits With Limited Expert Advice
    2013/06/19 by Kale, Satyen · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  23. Online Sparse Linear Regression
    2016/03/07 by Dean P. Foster, Foster, Dean, Satyen Kale +3 · 1 citation
    Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Optimization and Search Problems
  24. Almost Tight Bounds for Differentially Private Densest Subgraph
    2023/08/20 by Michael Dinitz, Dinitz, Michael, Satyen Kale +5 · 2 citations
    Computer Science · Social Sciences · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Internet Traffic Analysis and Secure E-voting #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
  25. Near-Optimal Algorithms for Online Matrix Prediction
    2012/03/31 by Elad Hazan, Satyen Kale, Hazan, Elad +3 · 1 citation
    Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Complexity and Algorithms in Graphs #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Optimization and Search Problems
  26. Eager Updates For Overlapped Communication and Computation in DiLoCo
    2025/02/18 by Kale, Satyen, Douillard, Arthur, Donchev, Yanislav · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  27. SGD: The Role of Implicit Regularization, Batch-size and Multiple-epochs
    2021/07/11 by Kale, Satyen, Sekhari, Ayush, Sridharan, Karthik · 1 citation
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  28. Optimal and Adaptive Algorithms for Online Boosting
    2015/02/09 by Beygelzimer, Alina, Kale, Satyen, Luo, Haipeng · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  29. Pushing the Efficiency-Regret Pareto Frontier for Online Learning of Portfolios and Quantum States
    2022/02/06 by Zimmert, Julian, Agarwal, Naman, Kale, Satyen · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  30. Self-Consistency of the Fokker-Planck Equation
    2022/06/02 by Shen, Zebang, Wang, Zhenfu, Kale, Satyen +3 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  31. Beyond Uniform Lipschitz Condition in Differentially Private Optimization
    2022/06/21 by Das, Rudrajit, Kale, Satyen, Xu, Zheng +2 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  32. Improved Differentially Private and Lazy Online Convex Optimization
    2023/12/15 by Agarwal, Naman, Kale, Satyen, Singh, Karan +1 · 1 citation
    #Cryptography and Security (cs.CR) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  33. Efficient Stagewise Pretraining via Progressive Subnetworks
    2024/02/08 by Panigrahi, Abhishek, Saunshi, Nikunj, Lyu, Kaifeng +4 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  34. Stacking as Accelerated Gradient Descent
    2024/03/08 by Agarwal, Naman, Awasthi, Pranjal, Kale, Satyen +1 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  35. AdaBoN: Adaptive Best-of-N Alignment
    2025/05/17 by Vinod Raman, Hilal Asi, Raman, Vinod +3 · 2 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques