Smith, Virginia
- Federated Optimization in Heterogeneous Networks
2018/12/14 by Li, Tian, Sahu, Anit Kumar, Zaheer, Manzil +3 · 247 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- LEAF: A Benchmark for Federated Settings
2018/12/03 by Sebastian Caldas, Caldas, Sebastian, Peter Wu +12 · 68 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data
- Ditto: Fair and Robust Federated Learning Through Personalization
2020/12/08 by Tian Li, Shengyuan Hu, Li, Tian +5 · 51 citations
Computer Science · #Cryptography and Data Security #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Federated Multi-Task Learning
2017/05/30 by Smith, Virginia, Chiang, Chao-Kai, Sanjabi, Maziar +1 · 30 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Fair Resource Allocation in Federated Learning
2019/05/25 by Li Tian, Li, Tian, Maziar Sanjabi +5 · 21 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- A Field Guide to Federated Optimization
2021/07/14 by Jianyu Wang, Zachary Charles, Wang, Jianyu +103 · 15 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold
2024/06/20 by Amrith Setlur, Saurabh K. Garg†, Setlur, Amrith +9 · 21 citations
Computer Science · #Educational Technology and Assessment
- A Kernel Theory of Modern Data Augmentation
2018/03/16 by Dao, Tri, Gu, Albert, Ratner, Alexander J. +3 · 7 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- One-Shot Federated Learning
2019/02/28 by Neel Guha, Guha, Neel, Ameet Talwalkar +3 · 11 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Tilted Empirical Risk Minimization
2020/07/02 by Li, Tian, Beirami, Ahmad, Sanjabi, Maziar +1 · 7 citations
#FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Guardrail Baselines for Unlearning in LLMs
2024/03/05 by Thaker, Pratiksha, Maurya, Yash, Hu, Shengyuan +2 · 13 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning
2024/06/19 by Shengyuan Hu, Yiwei Fu, Hu, Shengyuan +5 · 12 citations
Engineering · Neuroscience · #Brain Tumor Detection and Classification #FOS: Computer and information sciences #Fire Detection and Safety Systems #Machine Learning (cs.LG)
- On Tilted Losses in Machine Learning: Theory and Applications
2021/09/13 by Li Tian, Ahmad Beirami, Li, Tian +5 · 6 citations
Computer Science · Decision Sciences · Mathematics · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Risk and Portfolio Optimization #Statistical Methods and Inference
- CoCoA: A General Framework for Communication-Efficient Distributed Optimization
2016/11/07 by Virginia Smith, Smith, Virginia, Simone Forte +9 · 5 citations
Computer Science · #Complexity and Algorithms in Graphs #FOS: Computer and information sciences #Machine Learning (cs.LG) #Optimization and Search Problems #Stochastic Gradient Optimization Techniques
- Validating Large Language Models with ReLM
2022/11/21 by Michael Kuchnik, Kuchnik, Michael, Virginia Smith +3 · 6 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- On Privacy and Personalization in Cross-Silo Federated Learning
2022/06/16 by Ziyu Liu, Shengyuan Hu, Liu, Ziyu +5 · 6 citations
Computer Science · #Privacy-Preserving Technologies in Data
- No Free Lunch in LLM Watermarking: Trade-offs in Watermarking Design Choices
2024/02/25 by Pang, Qi, Hu, Shengyuan, Zheng, Wenting +1 · 8 citations
#Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Label Leakage and Protection in Two-party Split Learning
2021/02/17 by Li, Oscar, Sun, Jiankai, Yang, Xin +5 · 4 citations
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMs
2025/06/10 by Setlur, Amrith, Yang, Matthew Y. R., Snell, Charlie +5 · 21 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Position: LLM Unlearning Benchmarks are Weak Measures of Progress
2024/10/03 by Pratiksha Thaker, Thaker, Pratiksha, Shengyuan Hu +9 · 8 citations
Business, Management and Accounting · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Taxation and Legal Issues
- Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes
2024/02/08 by Dery, Lucio, Kolawole, Steven, Kagy, Jean-François +3 · 6 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Privacy for Free: Communication-Efficient Learning with Differential Privacy Using Sketches
2019/11/03 by Li, Tian, Liu, Zaoxing, Sekar, Vyas +1 · 3 citations
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Private Adaptive Optimization with Side Information
2022/02/12 by Tian Li, Li, Tian, Manzil Zaheer +5 · 4 citations
Computer Science · #Advanced Neural Network Applications #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines
2021/11/07 by Kuchnik, Michael, Klimovic, Ana, Simsa, Jiri +2 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Performance (cs.PF)
- Motley: Benchmarking Heterogeneity and Personalization in Federated Learning
2022/06/18 by Shanshan Wu, Wu, Shanshan, Tian Li +11 · 3 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC)
- FedDANE: A Federated Newton-Type Method
2020/01/07 by Li, Tian, Sahu, Anit Kumar, Zaheer, Manzil +3 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- On Large-Cohort Training for Federated Learning
2021/06/15 by Zachary Charles, Charles, Zachary, Zachary Garrett +7 · 3 citations
Computer Science · Decision Sciences · #Data Quality and Management #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
2024/06/25 by Aashiq Muhamed, Oscar Li, Muhamed, Aashiq +7 · 4 citations
Computer Science · #Advanced Neural Network Applications #Machine Learning and Algorithms #Neural Networks and Applications
- Federated LoRA with Sparse Communication
2024/06/07 by Kevin Kuo, Kuo, Kevin, Arian Raje +5 · 4 citations
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Indoor and Outdoor Localization Technologies #IoT Networks and Protocols #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- On the Benefits of Public Representations for Private Transfer Learning under Distribution Shift
2023/12/24 by Thaker, Pratiksha, Setlur, Amrith, Wu, Zhiwei Steven +1 · 3 citations
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- SAEs Can Improve Unlearning: Dynamic Sparse Autoencoder Guardrails for Precision Unlearning in LLMs
2025/04/11 by Aashiq Muhamed, Muhamed, Aashiq, Jacopo Bonato +5 · 7 citations
Engineering · #Medical Imaging and Analysis
- Communication-Efficient Distributed Dual Coordinate Ascent
2014/09/04 by Jaggi, Martin, Smith, Virginia, Takáč, Martin +4 · 1 citation
#68W15 #90C25 #C.1.4 #FOS: Computer and information sciences #FOS: Mathematics #G.1.6 #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Agreement-Based Cascading for Efficient Inference
2024/07/02 by Steven Kolawole, Kolawole, Steven, Don Kurian Dennis +5 · 3 citations
Computer Science · #AI in cancer detection #Neural Networks and Applications #Generative Adversarial Networks and Image Synthesis
- Progressive Compressed Records: Taking a Byte out of Deep Learning Data
2019/11/01 by Kuchnik, Michael, Amvrosiadis, George, Smith, Virginia · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Heterogeneity for the Win: One-Shot Federated Clustering
2021/03/01 by Don Kurian Dennis, Tian Li, Dennis, Don Kurian +3 · 1 citation
Computer Science · #Privacy-Preserving Technologies in Data #Internet Traffic Analysis and Secure E-voting #Mobile Crowdsensing and Crowdsourcing
- Two Sides of Meta-Learning Evaluation: In vs. Out of Distribution
2021/02/23 by Amrith Setlur, Oscar Li, Setlur, Amrith +3 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Multimodal Machine Learning Applications
- Adversarial Unlearning: Reducing Confidence Along Adversarial Directions
2022/06/03 by Amrith Setlur, Benjamin Eysenbach, Setlur, Amrith +5 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- BLUR: A Benchmark for LLM Unlearning Robust to Forget-Retain Overlap
2025/05/28 by Hu, Shengyuan, Kale, Neil, Thaker, Pratiksha +3 · 3 citations
Computer Science · #Adversarial Robustness in Machine Learning #Topic Modeling #Explainable Artificial Intelligence (XAI)
- NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA
2024/11/06 by Tobaben, Marlon, Souibgui, Mohamed Ali, Tito, Rubèn +24 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models
2024/11/01 by Muhamed, Aashiq, Diab, Mona, Smith, Virginia · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Exact Unlearning of Finetuning Data via Model Merging at Scale
2025/04/06 by Kevin Kuo, Kuo, Kevin, Amrith Setlur +6 · 4 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification
- Differentially Private Adaptive Optimization with Delayed Preconditioners
2022/12/01 by Li, Tian, Zaheer, Manzil, Liu, Ken Ziyu +3 · 1 citation
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Variance-Reduced Gradient Estimation via Noise-Reuse in Online Evolution Strategies
2023/04/21 by Li, Oscar, Harrison, James, Sohl-Dickstein, Jascha +2 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
- Position: Mechanistic Interpretability Should Prioritize Feature Consistency in SAEs
2025/05/26 by Xiangchen Song, Aashiq Muhamed, Song, Xiangchen +13 · 3 citations
Arts and Humanities · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Historical Studies in Central America #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Enhancing the Privacy of Federated Learning with Sketching
2019/11/05 by Zaoxing Liu, Tian Li, Liu, Zaoxing +5 · 1 citation
Computer Science · Social Sciences · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mobile Crowdsensing and Crowdsourcing #Networking and Internet Architecture (cs.NI) #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
- Maximizing Global Model Appeal in Federated Learning
2022/05/30 by Cho, Yae Jee, Jhunjhunwala, Divyansh, Li, Tian +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- RefusalBench: Generative Evaluation of Selective Refusal in Grounded Language Models
2025/10/12 by Muhamed, Aashiq, Ribeiro, Leonardo F. R., Dreyer, Markus +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MLI: An API for Distributed Machine Learning
2013/10/21 by Evan Sparks, Ameet Talwalkar, Sparks, Evan R. +15 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Graph Theory and Algorithms #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Parallel #and Cluster Computing (cs.DC)