Koh, Pang Wei
- On the Opportunities and Risks of Foundation Models
2021/08/16 by Rishi Bommasani, Drew A. Hudson, Bommasani, Rishi +233 · 11 voices · 527 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #Topic Modeling
- 2 OLMo 2 Furious
2024/12/31 by Team OLMo, OLMo, Team, P N Walsh +85 · 9 voices · 85 citations
Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques
- Understanding Black-box Predictions via Influence Functions
2017/03/14 by Koh, Pang Wei, Liang, Percy · 190 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- The Generative AI Paradox: "What It Can Create, It May Not Understand"
2023/10/31 by Peter West, West, Peter, Ximing Lu +27 · 5 voices · 13 citations
Computer Science · Social Sciences · Medicine · #cs.AI #cs.CL #cs.CV #cs.LG
- Concept Bottleneck Models
2020/07/09 by Pang Wei Koh, Koh, Pang Wei, Thao Nguyen +11 · 131 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Machine Learning in Bioinformatics #Metabolomics and Mass Spectrometry Studies #Machine Learning in Healthcare
- DataComp-LM: In search of the next generation of training sets for language models
2024/06/17 by Jeffrey Li, Alex Fang, Li, Jeffrey +121 · 2 voices · 78 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization
2019/11/20 by Shiori Sagawa, Pang Wei Koh, Sagawa, Shiori +5 · 126 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
2023/05/23 by Sewon Min, Min, Sewon, Kalpesh Krishna +15 · 143 citations
Computer Science · Social Sciences · #Topic Modeling #Natural Language Processing Techniques #Computational and Text Analysis Methods
- WILDS: A Benchmark of in-the-Wild Distribution Shifts
2020/12/14 by Pang Wei Koh, Koh, Pang Wei, Shiori Sagawa +43 · 92 citations
Computer Science · Medicine · #AI in cancer detection #COVID-19 diagnosis using AI #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
2020/04/15 by Miles Brundage, Brundage, Miles, Shahar Avin +115 · 2 voices · 21 citations
#cs.CY
- DataComp: In search of the next generation of multimodal datasets
2023/04/27 by Samir Yitzhak Gadre, Gadre, Samir Yitzhak, Gabriel Ilharco +65 · 76 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
- Just Train Twice: Improving Group Robustness without Training Group\n Information
2021/07/19 by Evan Liu, Liu, Evan Zheran, Behzad Haghgoo +15 · 38 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Reinforcement Learning in Robotics
- OLMoE: Open Mixture-of-Experts Language Models
2024/09/03 by Niklas Muennighoff, Luca Soldaini, Muennighoff, Niklas +45 · 1 voice · 60 citations
Computer Science · #Expert finding and Q&A systems #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models
2023/08/02 by Anas Awadalla, Awadalla, Anas, Irena Gao +29 · 49 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- On the Accuracy of Influence Functions for Measuring Group Effects
2019/05/30 by Pang Wei Koh, Kai-Siang Ang, Koh, Pang Wei +5 · 18 citations
Computer Science · Social Sciences · Decision Sciences · #Advanced Statistical Modeling Techniques #Computational and Text Analysis Methods #Psychometric Methodologies and Testing
- Are aligned neural networks adversarially aligned?
2023/06/26 by Carlini, Nicholas, Nasr, Milad, Choquette-Choo, Christopher A. +8 · 26 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Certified Defenses for Data Poisoning Attacks
2017/06/09 by Jacob Steinhardt, Steinhardt, Jacob, Pang Wei Koh +3 · 15 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Security and Intrusion Detection
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations
2020/05/09 by Shiori Sagawa, Aditi Raghunathan, Sagawa, Shiori +5 · 17 citations
Computer Science · #Reinforcement Learning in Robotics #Machine Learning and Data Classification #Evolutionary Algorithms and Applications
- MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoning
2024/06/03 by Shuyue Stella Li, Vidhisha Balachandran, Li, Shuyue Stella +11 · 27 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- Accuracy on the Line: On the Strong Correlation Between\n Out-of-Distribution and In-Distribution Generalization
2021/07/09 by J. J. Miller, Miller, John, Rohan Taori +15 · 12 citations
Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- Spurious Rewards: Rethinking Training Signals in RLVR
2025/06/12 by Rulin Shao, Shuyue Stella Li, Shao, Rulin +25 · 58 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- Scaling Retrieval-Based Language Models with a Trillion-Token Datastore
2024/07/09 by Shao, Rulin, He, Jacqueline, Asai, Akari +5 · 17 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
- JPEG-LM: LLMs as Image Generators with Canonical Codec Representations
2024/08/15 by Xiaochuang Han, Han, Xiaochuang, Marjan Ghazvininejad +5 · 2 voices · 1 citation
Computer Science · #Advanced Computational Techniques and Applications #cs.CL #cs.CV #cs.LG
- Instructional Fingerprinting of Large Language Models
2024/01/21 by Jiashu Xu, Fei Wang, Xu, Jiashu +9 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- Language models scale reliably with over-training and on downstream tasks
2024/03/13 by Samir Yitzhak Gadre, Georgios Smyrnis, Gadre, Samir Yitzhak +45 · 12 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
2024/11/21 by Akari Asai, Jacqueline He, Asai, Akari +50 · 2 voices · 13 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.AI #cs.CL #cs.DL #cs.IR #cs.LG
- ReasonIR: Training Retrievers for Reasoning Tasks
2025/04/29 by Shao, Rulin, Qiao, Rui, Kishore, Varsha +8 · 28 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
- OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens
2025/04/09 by Jiacheng Liu, Taylor Blanton, Liu, Jiacheng +61 · 3 voices · 8 citations
Computer Science · Medicine · #Topic Modeling #Natural Language Processing Techniques #Artificial Intelligence in Healthcare and Education
- Extending the WILDS Benchmark for Unsupervised Adaptation
2021/12/09 by Sagawa, Shiori, Koh, Pang Wei, Lee, Tony +17 · 6 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulations
2019/09/14 by Birnbaum, Sawyer, Kuleshov, Volodymyr, Enam, Zayd +2 · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Annotation alignment: Comparing LLM and human annotations of conversational safety
2024/06/10 by Movva, Rajiv, Koh, Pang Wei, Pierson, Emma · 8 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better
2024/06/07 by Scott Geng, Geng, Scott, Cheng-Yu Hsieh +11 · 8 citations
Medicine · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Surgical Simulation and Training
- Establishing Task Scaling Laws via Compute-Efficient Model Ladders
2024/12/05 by Bhagia, Akshita, Liu, Jiacheng, Wettig, Alexander +9 · 9 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- DataDecide: How to Predict Best Pretraining Data with Small Experiments
2025/04/15 by Ian Magnusson, Magnusson, Ian, Tai, Nguyen +22 · 12 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Out-of-Domain Robustness via Targeted Augmentations
2023/02/23 by Irena Gao, Shiori Sagawa, Gao, Irena +7 · 4 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG)
- Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models
2024/02/05 by Zhiyuan Hu, Hu, Zhiyuan, Chumin Liu +15 · 5 citations
Computer Science · #Topic Modeling
- Reliable, Adaptable, and Attributable Language Models with Retrieval
2024/03/05 by Asai, Akari, Zhong, Zexuan, Chen, Danqi +4 · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Multilingual Diversity Improves Vision-Language Representations
2024/05/27 by Thao D. Nguyen, Nguyen, Thao, Matthew Wallingford +13 · 5 citations
Arts and Humanities · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Media, Religion, Digital Communication
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation
2024/07/09 by Tong Chen, Chen, Tong, Akari Asai +15 · 6 citations
Computer Science · #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time
2022/11/25 by Yao, Huaxiu, Choi, Caroline, Cao, Bochuan +3 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Exploring How Generative MLLMs Perceive More Than CLIP with the Same Vision Encoder
2024/11/07 by Siting Li, Li, Siting, Pang Wei Koh +3 · 6 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Image Processing Techniques #FOS: Computer and information sciences #Genomic variations and chromosomal abnormalities #Machine Learning (cs.LG) #graph theory and CDMA systems
- ICONS: Influence Consensus for Vision-Language Data Selection
2024/12/31 by Xindi Wu, Mengzhou Xia, Wu, Xindi +9 · 7 citations
Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Advanced Image and Video Retrieval Techniques
- Selective Classification Can Magnify Disparities Across Groups
2020/10/27 by Jones, Erik, Sagawa, Shiori, Koh, Pang Wei +2 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- PLeaS -- Merging Models with Permutations and Least Squares
2024/07/02 by Anshul Nasery, Jonathan Hayase, Nasery, Anshul +5 · 4 citations
Business, Management and Accounting · #Business Strategy and Innovation #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Improving Domain Generalization with Domain Relations
2023/02/06 by Huaxiu Yao, Yao, Huaxiu, Xinyu Yang +9 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Bioinformatics #Topic Modeling
- DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
2025/11/24 by Shao, Rulin, Asai, Akari, Shen, Shannon Zejiang +18 · 7 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare
- S4S: Solving for a Diffusion Model Solver
2025/02/24 by E. T. Frankel, Sitan Chen, Frankel, Eric +9 · 4 citations
Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Numerical methods for differential equations
- Large-Scale Data Selection for Instruction Tuning
2025/03/03 by Ivison, Hamish, Zhang, Muru, Brahman, Faeze +2 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Fluid Language Model Benchmarking
2025/09/14 by Valentin Hofmann, David Heineman, Hofmann, Valentin +17 · 3 voices · 7 citations
#cs.CL #cs.AI #cs.LG
- FlexOlmo: Open Language Models for Flexible Data Use
2025/07/09 by Shi, Weijia, Bhagia, Akshita, Farhat, Kevin +20 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
2025/03/11 by Zeng, Zhiyuan, Wang, Yizhong, Hajishirzi, Hannaneh +1 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Frustratingly Simple Retrieval Improves Challenging, Reasoning-Intensive Benchmarks
2025/07/02 by Lyu, Xinxi, Duan, Michael, Shao, Rulin +2 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Proximity-Informed Calibration for Deep Neural Networks
2023/06/07 by Miao Xiong, Ailin Deng, Xiong, Miao +11 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training
2023/05/20 by Jieyu Zhang, Zhang, Jieyu, Bohan Wang +7 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification
- Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions
2025/03/10 by Qiao, Rui, Wu, Zhaoxuan, Wang, Jingtan +2 · 3 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Precise Information Control in Long-Form Text Generation
2025/06/06 by He, Jacqueline, Yen, Howard, Li, Margaret +7 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Using large language models to promote health equity
2023/12/22 by Pierson, Emma, Shanmugam, Divya, Movva, Rajiv +12 · 1 citation
#Computers and Society (cs.CY) #FOS: Computer and information sciences
- Information-Theoretic Distillation for Reference-less Summarization
2024/03/20 by Jung, Jaehun, Lu, Ximing, Jiang, Liwei +4 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- A False Sense of Privacy: Evaluating Textual Data Sanitization Beyond Surface-level Privacy Leakage
2025/04/28 by Rui Xin, Xin, Rui, Niloofar Mireshghallah +15 · 2 citations
Computer Science · Social Sciences · #Advanced Malware Detection Techniques #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
- The Delta Learning Hypothesis: Preference Tuning on Weak Data can Yield Strong Gains
2025/07/08 by Scott Geng, Geng, Scott, Hamish Ivison +11 · 3 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
- Negative Token Merging: Image-based Adversarial Feature Guidance
2024/12/02 by Singh, Jaskirat, Li, Lindsey, Shi, Weijia +7 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
2024/10/16 by Morrison, Jacob, Smith, Noah A., Hajishirzi, Hannaneh +3 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)