Charles, Zachary
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1398 citations
#cs.CL #cs.AI
- Advances and Open Problems in Federated Learning
2019/12/10 by Peter Kairouz, H. Brendan McMahan, Kairouz, Peter +115 · 490 citations
Computer Science · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Adaptive Federated Optimization
2020/02/29 by Reddi, Sashank, Charles, Zachary, Zaheer, Manzil +5 · 114 citations
#Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
- Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch
2025/01/30 by Arthur Douillard, Yanislav Donchev, Douillard, Arthur +26 · 7 voices · 12 citations
Computer Science · Social Sciences · #Multimedia Communication and Technology #Semantic Web and Ontologies #cs.CL
- A Field Guide to Federated Optimization
2021/07/14 by Jianyu Wang, Wang, Jianyu, Zachary Charles +103 · 25 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Stability and Generalization of Learning Algorithms that Converge to Global Optima
2017/10/23 by Zachary Charles, Charles, Zachary, Dimitris Papailiopoulos +1 · 16 citations
Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications #Optimization and Control (math.OC) #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- DRACO: Byzantine-resilient Distributed Training via Redundant Gradients
2018/03/27 by Lingjiao Chen, Hongyi Wang, Chen, Lingjiao +5 · 10 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Distributed #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- VaultGemma: A Differentially Private Gemma Model
2025/10/15 by Amer Sinha, Thomas Mésnard, Sinha, Amer +39 · 4 voices · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cryptography and Data Security #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data
- ATOMO: Communication-efficient Learning via Atomic Sparsification
2018/06/11 by Hongyi Wang, Wang, Hongyi, Scott Sievert +9 · 8 citations
Computer Science · #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
2025/03/12 by Zachary Charles, Gabriel Teston, Charles, Zachary +14 · 2 voices · 11 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC) #cs.CL #cs.DC #cs.LG
- Fine-Tuning Large Language Models with User-Level Differential Privacy
2024/07/10 by Zachary Charles, Charles, Zachary, Arun Ganesh +11 · 17 citations
Computer Science · #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation
2019/07/29 by Shashank Rajput, Hongyi Wang, Rajput, Shashank +5 · 4 citations
Computer Science · #Adversarial Robustness in Machine Learning #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- On the Outsized Importance of Learning Rates in Local Update Methods
2020/07/02 by Zachary Charles, Charles, Zachary, Jakub Konečný +1 · 9 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Domain Adaptation and Few-Shot Learning
- Motley: Benchmarking Heterogeneity and Personalization in Federated Learning
2022/06/18 by Shanshan Wu, Wu, Shanshan, Tian Li +11 · 5 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- Approximate Gradient Coding via Sparse Random Graphs
2017/11/17 by Zachary Charles, Charles, Zachary, Dimitris Papailiopoulos +3 · 4 citations
Computer Science · Engineering · #Computation (stat.CO) #Distributed #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Privacy-Preserving Technologies in Data #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Gradient Descent with Linearly Correlated Noise: Theory and Applications to Differential Privacy
2023/02/02 by Anastasia Koloskova, Koloskova, Anastasia, Ryan M. McKenna +7 · 4 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Stochastic Gradient Optimization Techniques
- Convergence and Margin of Adversarial Training on Separable Data
2019/05/22 by Zachary Charles, Shashank Rajput, Charles, Zachary +5 · 6 citations
Computer Science · #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Optimization and Control (math.OC)
- Scaling Laws for Differentially Private Language Models
2025/01/31 by Ryan McKenna, Ryan M. McKenna, Yangsibo Huang +23 · 2 voices · 6 citations
Computer Science · #cs.LG #cs.CR
- On Large-Cohort Training for Federated Learning
2021/06/15 by Zachary Charles, Zachary Garrett, Charles, Zachary +7 · 4 citations
Computer Science · Decision Sciences · #Data Quality and Management #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- ErasureHead: Distributed Gradient Descent without Delays Using Approximate Gradient Coding
2019/01/28 by Hongyi Wang, Zachary Charles, Wang, Hongyi +3 · 3 citations
Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data
- Does Data Augmentation Lead to Positive Margin?
2019/05/08 by Shashank Rajput, Rajput, Shashank, Zhili Feng +7 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification
- DrJAX: Scalable and Differentiable MapReduce Primitives in JAX
2024/03/11 by Keith Rush, Zachary Charles, Rush, Keith +5 · 2 citations
Computer Science · #Distributed #Distributed systems and fault tolerance #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Local Adaptivity in Federated Learning: Convergence and Consistency
2021/06/04 by Jianyu Wang, Wang, Jianyu, Zheng Xu +9 · 1 citation
Computer Science · Mathematics · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Privacy-Preserving Technologies in Data #Random Matrices and Applications #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Leveraging Function Space Aggregation for Federated Learning at Scale
2023/11/17 by Nikita Dhawan, Nicole Mitchell, Dhawan, Nikita +7 · 1 citation
Computer Science · #Privacy-Preserving Technologies in Data #Recommender Systems and Techniques
- A Geometric Perspective on the Transferability of Adversarial Directions
2018/11/08 by Zachary Charles, Charles, Zachary, Harrison Rosenberg +3 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)