Chiyuan Zhang
- Understanding deep learning requires rethinking generalization
2016/11/10 by Chiyuan Zhang, Samy Bengio, Zhang, Chiyuan +7 · 9 voices · 163 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Gaussian Processes and Bayesian Inference #Stochastic Gradient Optimization Techniques #cs.LG
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1347 citations
#cs.CL #cs.AI
- Machine Theory of Mind
2018/02/21 by Neil C. Rabinowitz, Rabinowitz, Neil C., Frank Perbet +10 · 4 voices · 40 citations
Social Sciences · Computer Science · #Evolutionary Game Theory and Cooperation #Reinforcement Learning in Robotics #Bayesian Modeling and Causal Inference
- Do Vision Transformers See Like Convolutional Neural Networks?
2021/08/19 by Maithra Raghu, Raghu, Maithra, Thomas Unterthiner +7 · 2 voices · 70 citations
#cs.CV #cs.AI #cs.LG #stat.ML
- Understanding deep learning (still) requires rethinking generalization
2021/02/22 by Chiyuan Zhang, Samy Bengio, Moritz Hardt +2 · 136 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Gaussian Processes and Bayesian Inference #Stochastic Gradient Optimization Techniques
- Transfusion: Understanding Transfer Learning for Medical Imaging
2019/02/14 by Maithra Raghu, Raghu, Maithra, Chiyuan Zhang +5 · 1 voice · 33 citations
Medicine · Computer Science · #COVID-19 diagnosis using AI #AI in cancer detection #Radiomics and Machine Learning in Medical Imaging
- Training Deep Nets with Sublinear Memory Cost
2016/04/21 by Tianqi Chen, Chen, Tianqi, Bing Xu +5 · 114 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
2015/12/03 by Tianqi Chen, Chen, Tianqi, Mu Li +17 · 127 citations
Engineering · Computer Science · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #IoT and Edge/Fog Computing
- Quantifying Memorization Across Neural Language Models
2022/02/15 by Nicholas Carlini, Daphne Ippolito, Carlini, Nicholas +9 · 71 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Deduplicating Training Data Makes Language Models Better
2021/07/14 by Katherine Lee, Lee, Katherine, Daphne Ippolito +11 · 58 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Learning with a Wasserstein Loss
2015/06/17 by Charlie Frogner, Frogner, Charlie, Chiyuan Zhang +7 · 31 citations
Computer Science · Medicine · #Topological and Geometric Data Analysis #Glioma Diagnosis and Treatment #Advanced Neuroimaging Techniques and Applications
- MUSE: Machine Unlearning Six-Way Evaluation for Language Models
2024/07/08 by Weijia Shi, Jaechan Lee, Shi, Weijia +17 · 45 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- A Study on Overfitting in Deep Reinforcement Learning
2018/04/18 by Chiyuan Zhang, Oriol Vinyals, Zhang, Chiyuan +5 · 15 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- The Privacy Onion Effect: Memorization is Relative
2022/06/21 by Nicholas Carlini, Carlini, Nicholas, Matthew Jagielski +9 · 16 citations
Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Cryptography and Security (cs.CR) #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data
- Counterfactual Memorization in Neural Language Models
2021/12/24 by Chiyuan Zhang, Zhang, Chiyuan, Daphne Ippolito +9 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Measuring Forgetting of Memorized Training Examples
2022/06/30 by Matthew Jagielski, Om Thakkar, Jagielski, Matthew +19 · 12 citations
Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Topic Modeling
- On Memorization of Large Language Models in Logical Reasoning
2024/10/30 by Chulin Xie, Yangsibo Huang, Xie, Chulin +15 · 24 citations
Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Deep Learning with Label Differential Privacy
2021/02/11 by Badih Ghazi, Ghazi, Badih, Noah Golowich +7 · 7 citations
Computer Science · #Adversarial Robustness in Machine Learning #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques
- Can Neural Network Memorization Be Localized?
2023/07/18 by Pratyush Maini, Maini, Pratyush, Michael C. Mozer +9 · 6 citations
Computer Science · Physics and Astronomy · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks
- Evaluating Copyright Takedown Methods for Language Models
2024/06/26 by Boyi Wei, Wei, Boyi, Weijia Shi +13 · 8 citations
Computer Science · #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Localizing Paragraph Memorization in Language Models
2024/03/28 by Niklas Stoehr, Mitchell Gordon, Stoehr, Niklas +5 · 4 citations
Computer Science · #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Scaling Laws for Differentially Private Language Models
2025/01/31 by Ryan M. McKenna, Ryan McKenna, McKenna, Ryan +23 · 2 voices · 5 citations
Computer Science · #cs.LG #cs.CR
- Scaling Embedding Layers in Language Models
2025/02/03 by Dahua Yu, Edith Cohen, Yu, Da +13 · 5 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models
2024/06/23 by Lynn Chua, Chua, Lynn, Badih Ghazi +15 · 3 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling
- Scalable DP-SGD: Shuffling vs. Poisson Subsampling
2024/11/06 by Lynn Chua, Badih Ghazi, Chua, Lynn +11 · 4 citations
Computer Science · Engineering · #3D Shape Modeling and Analysis #Computer Graphics and Visualization Techniques #Cryptography and Security (cs.CR) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Medical Image Segmentation Techniques
- How Private are DP-SGD Implementations?
2024/03/26 by Lynn Chua, Chua, Lynn, Badih Ghazi +11 · 2 citations
Medicine · #Biomedical Ethics and Regulation #Cryptography and Security (cs.CR) #Data Structures and Algorithms (cs.DS) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Understanding Invariance via Feedforward Inversion of Discriminatively Trained Classifiers
2021/03/15 by Piotr Teterwak, Teterwak, Piotr, Chiyuan Zhang +5 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
- Private Ad Modeling with DP-SGD
2022/11/21 by Carson Denison, Denison, Carson, Badih Ghazi +15 · 1 citation
Computer Science · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data
- Ticketed Learning-Unlearning Schemes
2023/06/27 by Badih Ghazi, Pritish Kamath, Ghazi, Badih +9 · 1 citation
Computer Science · #Machine Learning and Algorithms #Machine Learning and Data Classification #Stochastic Gradient Optimization Techniques
- Optimal Unbiased Randomizers for Regression with Label Differential Privacy
2023/12/09 by Ashwinkumar Badanidiyuru, Badanidiyuru, Ashwinkumar, Badih Ghazi +13 · 1 citation
Computer Science · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Privacy-Preserving Technologies in Data
- Sparsity-Preserving Differentially Private Training of Large Embedding Models
2023/11/14 by Badih Ghazi, Yangsibo Huang, Ghazi, Badih +11 · 1 citation
Computer Science · Social Sciences · #Privacy-Preserving Technologies in Data #Privacy, Security, and Data Protection
- Training Differentially Private Ad Prediction Models with Semi-Sensitive Features
2024/01/26 by Lynn Chua, Chua, Lynn, Qiliang Cui +21 · 1 citation
Computer Science · #Cryptography and Security (cs.CR) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data
- Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning
2024/06/20 by Lynn Chua, Chua, Lynn, Badih Ghazi +14 · 1 citation
Computer Science · Social Sciences · #Access Control and Trust #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
- Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracy
2024/10/12 by Yangsibo Huang, Daogao Liu, Huang, Yangsibo +17 · 1 citation
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Fault Detection and Control Systems