Raghunathan, Aditi
- On the Opportunities and Risks of Foundation Models
2021/08/16 by Rishi Bommasani, Drew A. Hudson, Bommasani, Rishi +233 · 11 voices · 547 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #Topic Modeling
- Scaling Laws for Precision
2024/11/07 by Tanishq Kumar, Zachary Ankner, Kumar, Tanishq +16 · 7 voices · 29 citations
Arts and Humanities · #Philosophy and History of Science
- An Explanation of In-context Learning as Implicit Bayesian Inference
2021/11/03 by Sang Michael Xie, Xie, Sang Michael, Aditi Raghunathan +5 · 91 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution
2022/02/21 by Kumar, Ananya, Raghunathan, Aditi, Jones, Robbie +2 · 56 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Just Train Twice: Improving Group Robustness without Training Group\n Information
2021/07/19 by Evan Liu, Liu, Evan Zheran, Behzad Haghgoo +15 · 40 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Reinforcement Learning in Robotics
- Overtrained Language Models Are Harder to Fine-Tune
2025/03/24 by Jacob Mitchell Springer, Jacob M. Springer, Springer, Jacob Mitchell +14 · 8 voices · 23 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- The Pitfalls of Simplicity Bias in Neural Networks
2020/06/13 by Harshay Shah, Shah, Harshay, Kaustav Tamuly +7 · 25 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations
2020/05/09 by Shiori Sagawa, Aditi Raghunathan, Sagawa, Shiori +5 · 18 citations
Computer Science · #Reinforcement Learning in Robotics #Machine Learning and Data Classification #Evolutionary Algorithms and Applications
- Unlabeled Data Improves Adversarial Robustness
2019/05/31 by Yair Carmon, Aditi Raghunathan, Carmon, Yair +7 · 19 citations
Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
- Accuracy on the Line: On the Strong Correlation Between\n Out-of-Distribution and In-Distribution Generalization
2021/07/09 by J. J. Miller, Rohan Taori, Miller, John +15 · 15 citations
Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- Understanding Catastrophic Forgetting in Language Models via Implicit Inference
2023/09/18 by Suhas Kotha, Jacob M. Springer, Kotha, Suhas +3 · 22 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- Automatically Auditing Large Language Models via Discrete Optimization
2023/03/08 by Erik Jones, Jones, Erik, Anca D. Dragan +5 · 18 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Infrastructure Maintenance and Monitoring #Machine Learning (cs.LG) #Machine Learning and Data Classification #Software Engineering Research
- Dissecting Adversarial Robustness of Multimodal LM Agents
2024/06/18 by Chen Wu, Wu, Chen Henry, Shah, Rishi +8 · 25 citations
Computer Science · #Adversarial Robustness in Machine Learning
- Certified Robustness to Adversarial Word Substitutions
2019/09/03 by Robin Jia, Jia, Robin, Aditi Raghunathan +5 · 14 citations
Computer Science · #Adversarial Robustness in Machine Learning #Topic Modeling #Hate Speech and Cyberbullying Detection
- Finetune like you pretrain: Improved finetuning of zero-shot vision models
2022/12/01 by Sachin Goyal, Goyal, Sachin, Ananya Kumar +7 · 15 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Repetition Improves Language Model Embeddings
2024/02/23 by Jacob M. Springer, Springer, Jacob Mitchell, Suhas Kotha +7 · 17 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Agreement-on-the-Line: Predicting the Performance of Neural Networks under Distribution Shift
2022/06/27 by Baek, Christina, Jiang, Yiding, Raghunathan, Aditi +1 · 9 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Scaling Laws for Data Filtering -- Data Curation cannot be Compute Agnostic
2024/04/10 by Sachin Goyal, Goyal, Sachin, Pratyush Maini +7 · 13 citations
Decision Sciences · #Big Data Technologies and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
2025/04/21 by Vaishnavh Nagarajan, Nagarajan, Vaishnavh, Chen Henry Wu +5 · 4 voices · 14 citations
#cs.LG #cs.AI #cs.CL
- Semidefinite relaxations for certifying robustness to adversarial\n examples
2018/11/02 by Aditi Raghunathan, Raghunathan, Aditi, Jacob Steinhardt +3 · 9 citations
Computer Science · #Adversarial Robustness in Machine Learning #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- DROCC: Deep Robust One-Class Classification
2020/02/28 by Sachin Goyal, Aditi Raghunathan, Goyal, Sachin +7 · 6 citations
Computer Science · Medicine · #Anomaly Detection Techniques and Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Understanding and Mitigating the Tradeoff Between Robustness and Accuracy
2020/02/25 by Raghunathan, Aditi, Xie, Sang Michael, Yang, Fanny +2 · 5 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Certified Defenses against Adversarial Examples
2018/01/29 by Raghunathan, Aditi, Steinhardt, Jacob, Liang, Percy · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Test-Time Adaptation via Conjugate Pseudo-labels
2022/07/20 by Sachin Goyal, Goyal, Sachin, Ming-Jie Sun +5 · 6 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications #Machine Learning and Data Classification
- Why is SAM Robust to Label Noise?
2024/05/06 by Christina Baek, Baek, Christina, Zico Kolter +3 · 7 citations
Engineering · #Advanced Chemical Sensor Technologies #FOS: Computer and information sciences #Fault Detection and Control Systems #Infrastructure Maintenance and Monitoring #Machine Learning (cs.LG)
- Adversarial Training Can Hurt Generalization
2019/06/14 by Raghunathan, Aditi, Xie, Sang Michael, Yang, Fanny +2 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Weight Ensembling Improves Reasoning in Language Models
2025/04/14 by Dang, Xingyu, Christina Baek, Baek, Christina +6 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Using Language to Extend to Unseen Domains
2022/10/18 by Lisa Dunlap, Clara Mohri, Dunlap, Lisa +12 · 4 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
- Enabling certification of verification-agnostic networks via memory-efficient semidefinite programming
2020/10/22 by Sumanth Dathathri, Dathathri, Sumanth, Krishnamurthy Dvijotham +19 · 3 citations
Computer Science · #Adversarial Robustness in Machine Learning #Machine Learning and Algorithms #Physical Unclonable Functions (PUFs) and Hardware Security
- Context-Parametric Inversion: Why Instruction Finetuning Can Worsen Context Reliance
2024/10/14 by Goyal, Sachin, Baek, Christina, Kolter, J. Zico +1 · 7 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Understanding Finetuning for Factual Knowledge Extraction
2024/06/20 by Ghosal, Gaurav, Hashimoto, Tatsunori, Raghunathan, Aditi · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Robust Encodings: A Framework for Combating Adversarial Typos
2020/05/04 by Erik Jones, Jones, Erik, Robin Jia +5 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering Research #Topic Modeling
- Decoupling Exploration and Exploitation for Meta-Reinforcement Learning\n without Sacrifices
2020/08/06 by Evan Zheran Liu, Liu, Evan Zheran, Aditi Raghunathan +5 · 2 citations
Computer Science · Decision Sciences · Neuroscience · #Advanced Bandit Algorithms Research #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural dynamics and brain function #Reinforcement Learning in Robotics
- ALP: Action-Aware Embodied Learning for Perception
2023/06/16 by Liang, Xinran, Han, Anthony, Yan, Wilson +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Robotics (cs.RO)
- Reasoning as an Adaptive Defense for Safety
2025/07/01 by Taeyoun Kim, Kim, Taeyoun, Fahim Tajwar +5 · 9 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Security and Verification in Computing #Software Testing and Debugging Techniques
- AutoFT: Learning an Objective for Robust Fine-Tuning
2024/01/18 by Choi, Caroline, Lee, Yoonho, Chen, Annie +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Predicting the Performance of Foundation Models via Agreement-on-the-Line
2024/04/02 by Rahul Saxena, Taeyoun Kim, Saxena, Rahul +9 · 2 citations
Computer Science · Business, Management and Accounting · #Semantic Web and Ontologies #Multi-Agent Systems and Negotiation #Business Process Modeling and Analysis
- ImpossibleBench: Measuring LLMs' Propensity of Exploiting Test Cases
2025/10/23 by Ziqian Zhong, Zhong, Ziqian, Aditi Raghunathan +3 · 1 voice · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.CL #cs.LG
- Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning
2024/05/30 by Jacob M. Springer, Vaishnavh Nagarajan, Springer, Jacob Mitchell +3 · 2 citations
Engineering · #Industrial Vision Systems and Defect Detection
- Calibrated ensembles can mitigate accuracy tradeoffs under distribution shift
2022/07/18 by Kumar, Ananya, Ma, Tengyu, Liang, Percy +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Exact Unlearning of Finetuning Data via Model Merging at Scale
2025/04/06 by Kevin Kuo, Kuo, Kevin, Amrith Setlur +6 · 4 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification
- T-MARS: Improving Visual Representations by Circumventing Text Feature Learning
2023/07/06 by Maini, Pratyush, Goyal, Sachin, Lipton, Zachary C. +2 · 1 citation
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Vulnerability of Text-Matching in ML/AI Conference Reviewer Assignments to Collusions
2024/12/09 by Jhih-Yi, Aditi Raghunathan, Hsieh, Jhih-Yi +3 · 3 citations
Computer Science · Medicine · Social Sciences · #Access Control and Trust #Artificial Intelligence in Healthcare and Education #Cryptography and Security (cs.CR) #Digital Libraries (cs.DL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisions
2025/03/05 by Emmy Liu, Amanda Bertsch, Liu, Emmy +20 · 2 citations
Computer Science · Materials Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Topic Modeling
- Testing the Limits of Jailbreaking Defenses with the Purple Problem
2024/03/20 by Kim, Taeyoun, Kotha, Suhas, Raghunathan, Aditi · 1 citation
#Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Memorization Sinks: Isolating Memorization during LLM Training
2025/07/14 by Gaurav R. Ghosal, Pratyush Maini, Ghosal, Gaurav R. +3 · 3 citations
Computer Science · Social Sciences · #Software Engineering Research #Software Engineering Techniques and Practices #Wikis in Education and Collaboration
- Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs
2025/07/31 by Zhong, Ziqian, Raghunathan, Aditi · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)