Satyen Kale
- Estimating Training Data Influence by Tracing Gradient Descent
2020/02/19 by Garima Pruthi, Frederick Liu, Pruthi, Garima +5 · 113 citations
Business, Management and Accounting · Decision Sciences · #AI and HR Technologies #Scheduling and Timetabling Solutions
- Taming the Monster: A Fast and Simple Algorithm for Contextual Bandits
2014/02/04 by Alekh Agarwal, Agarwal, Alekh, Daniel Hsu +9 · 84 citations
Decision Sciences · Computer Science · #Advanced Bandit Algorithms Research #Machine Learning and Algorithms #Data Stream Mining Techniques
- Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch
2025/01/30 by Arthur Douillard, Douillard, Arthur, Yanislav Donchev +26 · 7 voices · 10 citations
Computer Science · Social Sciences · #Multimedia Communication and Technology #Semantic Web and Ontologies #cs.CL
- SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
2019/10/14 by Sai Praneeth Karimireddy, Satyen Kale, Karimireddy, Sai Praneeth +9 · 34 citations
Computer Science · #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Cryptography and Data Security
- A Field Guide to Federated Optimization
2021/07/14 by Jianyu Wang, Wang, Jianyu, Zachary Charles +103 · 24 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
2020/08/08 by Sai Praneeth Karimireddy, Karimireddy, Sai Praneeth, Martin Jaggi +11 · 12 citations
Computer Science · #68W15 #68W40 #90C06 #90C25 #Cryptography and Data Security #Distributed #E.4 #F.2.1 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Contextual Bandit Learning with Predictable Rewards
2012/02/07 by Alekh Agarwal, Agarwal, Alekh, Miroslav Dudı́k +7 · 8 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Smart Grid Energy Management
- Asynchronous Local-SGD Training for Language Modeling
2024/01/17 by Bo Liu, Liu, Bo, Rachita Chhaparia +13 · 2 voices · 5 citations
#cs.LG #cs.CL
- Projection-free Online Learning
2012/06/18 by Elad Hazan, Hazan, Elad, Satyen Kale +1 · 5 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Data Structures and Algorithms (cs.DS) #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #Machine Learning (cs.LG) #Sparse and Compressive Sensing Techniques
- Online Gradient Boosting
2015/06/16 by Alina Beygelzimer, Beygelzimer, Alina, Elad Hazan +5 · 6 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Sparse and Compressive Sensing Techniques
- Learning with User-Level Privacy
2021/02/23 by Daniel Lévy, Ziteng Sun, Levy, Daniel +11 · 5 citations
Computer Science · #Complexity and Algorithms in Graphs #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Efficient and Practical Stochastic Subgradient Descent for Nuclear Norm Regularization
2012/06/27 by Haim Avron, Satyen Kale, Avron, Haim +5 · 4 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Matrix Theory and Algorithms #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- On the Convergence of Federated Averaging with Cyclic Client Participation
2023/02/06 by Yae Jee Cho, Pranay Sharma, Cho, Yae Jee +9 · 4 citations
Computer Science · #Cooperative Communication and Network Coding #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Wireless Networks and Protocols #and Cluster Computing (cs.DC)
- Reproducibility in Optimization: Theoretical Framework and Limits
2022/02/09 by Kwangjun Ahn, Prateek Jain, Ahn, Kwangjun +9 · 3 citations
Computer Science · Engineering · Decision Sciences · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Advanced Bandit Algorithms Research
- Near-Optimal Algorithms for Online Matrix Prediction
2012/03/31 by Elad Hazan, Hazan, Elad, Satyen Kale +3 · 2 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Complexity and Algorithms in Graphs #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Optimization and Search Problems
- Escaping Saddle Points with Adaptive Gradient Methods
2019/01/26 by Matthew Staib, Sashank J. Reddi, Staib, Matthew +7 · 2 citations
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Data
2022/06/09 by Jianyu Wang, Rudrajit Das, Wang, Jianyu +9 · 3 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #Traffic Prediction and Management Techniques
- Almost Tight Bounds for Differentially Private Densest Subgraph
2023/08/20 by Michael Dinitz, Dinitz, Michael, Satyen Kale +5 · 3 citations
Computer Science · Social Sciences · #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Internet Traffic Analysis and Secure E-voting #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
- Optimal and Adaptive Algorithms for Online Boosting
2015/02/09 by Alina Beygelzimer, Satyen Kale, Beygelzimer, Alina +3 · 2 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Optimization and Search Problems
- Online Sparse Linear Regression
2016/03/07 by Dean P. Foster, Satyen Kale, Foster, Dean +3 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Optimization and Search Problems
- Stacking as Accelerated Gradient Descent
2024/03/08 by Naman Agarwal, Agarwal, Naman, Pranjal Awasthi +5 · 2 citations
Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Surface Roughness and Optical Measurements #Welding Techniques and Residual Stresses
- Efficient Methods for Online Multiclass Logistic Regression
2021/10/06 by Naman Agarwal, Satyen Kale, Agarwal, Naman +3 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Optimization and Search Problems
- AdaBoN: Adaptive Best-of-N Alignment
2025/05/17 by Vinod Raman, Hilal Asi, Raman, Vinod +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques