Katherine Lee
- Scalable Extraction of Training Data from (Production) Language Models
2023/11/28 by Milad Nasr, Nicholas Carlini, Nasr, Milad +17 · 21 voices · 66 citations
Computer Science · #Adversarial Robustness in Machine Learning #Topic Modeling #Explainable Artificial Intelligence (XAI)
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
2019/10/23 by Colin Raffel, Noam Shazeer, Raffel, Colin +16 · 4 voices · 1175 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG #stat.ML
- Extracting Training Data from Large Language Models
2020/12/14 by Nicholas Carlini, Florian Tramer, Florian Tramèr +25 · 8 voices · 239 citations
Computer Science · #Adversarial Robustness in Machine Learning #Privacy-Preserving Technologies in Data #Topic Modeling #cs.CL #cs.CR #cs.LG
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1352 citations
#cs.CL #cs.AI
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
2024/03/08 by Gemini Robotics Team, Gemini Team, Petko Georgiev +2277 · 4 voices · 540 citations
Computer Science · #Semantic Web and Ontologies
- Stealing Part of a Production Language Model
2024/03/11 by Nicholas Carlini, Carlini, Nicholas, Daniel Paleka +26 · 11 voices · 26 citations
Computer Science · #Natural Language Processing Techniques #cs.CR
- PaLM: Scaling Language Modeling with Pathways
2022/04/05 by Aakanksha Chowdhery, Chowdhery, Aakanksha, Sharan Narang +129 · 392 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Gemma: Open Models Based on Gemini Research and Technology
2024/03/13 by Thomas Mésnard, Gemma Team, Mesnard, Thomas +203 · 147 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation
- Quantifying Memorization Across Neural Language Models
2022/02/15 by Nicholas Carlini, Carlini, Nicholas, Daphne Ippolito +9 · 73 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Deduplicating Training Data Makes Language Models Better
2021/07/14 by Katherine Lee, Lee, Katherine, Daphne Ippolito +11 · 58 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- PaLM 2 Technical Report
2023/05/17 by Rohan Anil, Andrew M. Dai, Anil, Rohan +224 · 68 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- An Abundance of Katherines: The Game Theory of Baby Naming
2024/03/31 by Katy Blumer, Kate Donahue, Blumer, Katy +15 · 6 voices
Social Sciences · #Names, Identity, and Discrimination Research #cs.CY #cs.GT
- What Does it Mean for a Language Model to Preserve Privacy?
2022/02/11 by Hannah Brown, Brown, Hannah, Katherine Lee +7 · 22 citations
Computer Science · #Privacy-Preserving Technologies in Data
- Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research
2024/12/09 by A. Feder Cooper, Christopher A. Choquette-Choo, Cooper, A. Feder +75 · 5 voices · 8 citations
Computer Science · Social Sciences · #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #cs.AI #cs.CY #cs.LG
- A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity
2023/05/22 by Shayne Longpre, Gregory Yauney, Longpre, Shayne +18 · 26 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
- Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy
2022/10/31 by Daphne Ippolito, Ippolito, Daphne, Florian Tramèr +13 · 23 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Counterfactual Memorization in Neural Language Models
2021/12/24 by Chiyuan Zhang, Daphne Ippolito, Zhang, Chiyuan +9 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Measuring Forgetting of Memorized Training Examples
2022/06/30 by Matthew Jagielski, Om Thakkar, Jagielski, Matthew +19 · 12 citations
Computer Science · #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy-Preserving Technologies in Data #Topic Modeling
- Gemini: A Family of Highly Capable Multimodal Models
2023/12/19 by Gemini Team, Rohan Anil, Anil, Rohan +2682 · 9 voices
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.AI #cs.CL #cs.CV
- Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon
2024/06/25 by USVSN Sai Prashanth, Alvin Deng, Prashanth, USVSN Sai +23 · 3 voices · 4 citations
Arts and Humanities · #EFL/ESL Teaching and Learning
- WT5?! Training Text-to-Text Models to Explain their Predictions
2020/04/30 by Sharan Narang, Colin Raffel, Narang, Sharan +9 · 8 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Talkin' 'Bout AI Generation: Copyright and the Generative-AI Supply Chain
2023/09/15 by Katherine Lee, A. Feder Cooper, Lee, Katherine +3 · 3 voices · 5 citations
Computer Science · Social Sciences · Economics, Econometrics and Finance · #Law, AI, and Intellectual Property #Ethics and Social Impacts of AI #Digital Transformation in Law
- Students Parrot Their Teachers: Membership Inference on Model Distillation
2023/03/06 by Matthew Jagielski, Jagielski, Matthew, Milad Nasr +7 · 1 voice · 3 citations
#cs.CR #cs.LG
- Privacy Ripple Effects from Adding or Removing Personal Information in Language Model Training
2025/02/21 by Jaydeep Borkar, Matthew Jagielski, Borkar, Jaydeep +9 · 3 voices · 5 citations
#cs.CL #cs.CR
- Exploring the limits of strong membership inference attacks on large language models
2025/05/24 by Jamie Hayes, Ilia Shumailov, Hayes, Jamie +29 · 2 voices · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling #cs.AI #cs.CR #cs.LG
- Talkin’ ‘Bout AI Generation: Copyright and the Generative AI Supply Chain
2023/01/01 by Katherine Lee, A. Feder Cooper, James Grimmelmann · 1 voice · 1 citation
Business, Management and Accounting · Computer Science · Social Sciences · #Ethics and Social Impacts of AI #FinTech, Crowdfunding, Digital Finance #Law, AI, and Intellectual Property