Pang Wei Koh
- On the Opportunities and Risks of Foundation Models
2021/08/16 by Rishi Bommasani, Bommasani, Rishi, Drew A. Hudson +233 · 11 voices · 527 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #Topic Modeling
- 2 OLMo 2 Furious
2024/12/31 by Team OLMo, OLMo, Team, Pete Walsh +85 · 9 voices · 85 citations
Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques
- The Generative AI Paradox: "What It Can Create, It May Not Understand"
2023/10/31 by Peter West, Ximing Lu, West, Peter +27 · 5 voices · 13 citations
Computer Science · Social Sciences · Medicine · #cs.AI #cs.CL #cs.CV #cs.LG
- Concept Bottleneck Models
2020/07/09 by Pang Wei Koh, Koh, Pang Wei, Thao Nguyen +11 · 131 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Machine Learning in Bioinformatics #Metabolomics and Mass Spectrometry Studies #Machine Learning in Healthcare
- DataComp-LM: In search of the next generation of training sets for language models
2024/06/17 by Jeffrey Li, Li, Jeffrey, Alex Fang +121 · 2 voices · 78 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization
2019/11/20 by Shiori Sagawa, Sagawa, Shiori, Pang Wei Koh +5 · 126 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
2023/05/23 by Sewon Min, Min, Sewon, Kalpesh Krishna +15 · 143 citations
Computer Science · Social Sciences · #Topic Modeling #Natural Language Processing Techniques #Computational and Text Analysis Methods
- Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
2020/04/15 by Miles Brundage, Brundage, Miles, Shahar Avin +115 · 2 voices · 21 citations
#cs.CY
- WILDS: A Benchmark of in-the-Wild Distribution Shifts
2020/12/14 by Pang Wei Koh, Shiori Sagawa, Koh, Pang Wei +43 · 90 citations
Computer Science · Medicine · #AI in cancer detection #COVID-19 diagnosis using AI #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- DataComp: In search of the next generation of multimodal datasets
2023/04/27 by Samir Yitzhak Gadre, Gabriel Ilharco, Gadre, Samir Yitzhak +65 · 76 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
- The Keys to Classroom Management.
2000/01/01 by Serina Chang, Emma Pierson, Pang Wei Koh +6 · 21 citations
Mathematics · Medicine · Social Sciences · #COVID-19 epidemiological studies #Data-Driven Disease Surveillance #Human Mobility and Location-Based Analysis #Online and Blended Learning
- Just Train Twice: Improving Group Robustness without Training Group\n Information
2021/07/19 by Evan Liu, Liu, Evan Zheran, Behzad Haghgoo +15 · 38 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Reinforcement Learning in Robotics
- OLMoE: Open Mixture-of-Experts Language Models
2024/09/03 by Niklas Muennighoff, Muennighoff, Niklas, Luca Soldaini +45 · 1 voice · 60 citations
Computer Science · #Expert finding and Q&A systems #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models
2023/08/02 by Anas Awadalla, Awadalla, Anas, Irena Gao +29 · 49 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- On the Accuracy of Influence Functions for Measuring Group Effects
2019/05/30 by Pang Wei Koh, Koh, Pang Wei, Kai-Siang Ang +5 · 18 citations
Computer Science · Social Sciences · Decision Sciences · #Advanced Statistical Modeling Techniques #Computational and Text Analysis Methods #Psychometric Methodologies and Testing
- Certified Defenses for Data Poisoning Attacks
2017/06/09 by Jacob Steinhardt, Steinhardt, Jacob, Pang Wei Koh +3 · 15 citations
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Security and Intrusion Detection
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations
2020/05/09 by Shiori Sagawa, Sagawa, Shiori, Aditi Raghunathan +5 · 17 citations
Computer Science · #Reinforcement Learning in Robotics #Machine Learning and Data Classification #Evolutionary Algorithms and Applications
- MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoning
2024/06/03 by Shuyue Stella Li, Li, Shuyue Stella, Vidhisha Balachandran +11 · 27 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
- Accuracy on the Line: On the Strong Correlation Between\n Out-of-Distribution and In-Distribution Generalization
2021/07/09 by J. J. Miller, Rohan Taori, Miller, John +15 · 12 citations
Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- Spurious Rewards: Rethinking Training Signals in RLVR
2025/06/12 by Rulin Shao, Shuyue Stella Li, Shao, Rulin +25 · 58 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- JPEG-LM: LLMs as Image Generators with Canonical Codec Representations
2024/08/15 by Xiaochuang Han, Marjan Ghazvininejad, Han, Xiaochuang +5 · 2 voices · 1 citation
Computer Science · #Advanced Computational Techniques and Applications #cs.CL #cs.CV #cs.LG
- Instructional Fingerprinting of Large Language Models
2024/01/21 by Jiashu Xu, Fei Wang, Xu, Jiashu +9 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
2024/11/21 by Akari Asai, Asai, Akari, Jacqueline He +50 · 2 voices · 13 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.AI #cs.CL #cs.DL #cs.IR #cs.LG
- OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens
2025/04/09 by Jiacheng Liu, Liu, Jiacheng, Taylor Blanton +61 · 3 voices · 8 citations
Computer Science · Medicine · #Topic Modeling #Natural Language Processing Techniques #Artificial Intelligence in Healthcare and Education
- The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better
2024/06/07 by Scott Geng, Cheng-Yu Hsieh, Geng, Scott +11 · 8 citations
Medicine · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Surgical Simulation and Training
- DataDecide: How to Predict Best Pretraining Data with Small Experiments
2025/04/15 by Ian Magnusson, Magnusson, Ian, Ben Bogin +22 · 12 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Out-of-Domain Robustness via Targeted Augmentations
2023/02/23 by Irena Gao, Gao, Irena, Shiori Sagawa +7 · 4 citations
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG)
- Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models
2024/02/05 by Zhiyuan Hu, Hu, Zhiyuan, Chumin Liu +15 · 5 citations
Computer Science · #Topic Modeling
- Multilingual Diversity Improves Vision-Language Representations
2024/05/27 by Thao D. Nguyen, Matthew Wallingford, Nguyen, Thao +13 · 5 citations
Arts and Humanities · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Media, Religion, Digital Communication
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation
2024/07/09 by Tong Chen, Chen, Tong, Akari Asai +15 · 6 citations
Computer Science · #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Exploring How Generative MLLMs Perceive More Than CLIP with the Same Vision Encoder
2024/11/07 by Siting Li, Pang Wei Koh, Li, Siting +3 · 6 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Image Processing Techniques #FOS: Computer and information sciences #Genomic variations and chromosomal abnormalities #Machine Learning (cs.LG) #graph theory and CDMA systems
- ICONS: Influence Consensus for Vision-Language Data Selection
2024/12/31 by Xindi Wu, Wu, Xindi, Mengzhou Xia +9 · 7 citations
Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Advanced Image and Video Retrieval Techniques
- PLeaS -- Merging Models with Permutations and Least Squares
2024/07/02 by Anshul Nasery, Nasery, Anshul, Jonathan Hayase +5 · 4 citations
Business, Management and Accounting · #Business Strategy and Innovation #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Improving Domain Generalization with Domain Relations
2023/02/06 by Huaxiu Yao, Xinyu Yang, Yao, Huaxiu +9 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Bioinformatics #Topic Modeling
- S4S: Solving for a Diffusion Model Solver
2025/02/24 by E. T. Frankel, Frankel, Eric, Sitan Chen +9 · 4 citations
Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Numerical methods for differential equations
- Fluid Language Model Benchmarking
2025/09/14 by Valentin Hofmann, Hofmann, Valentin, David Heineman +17 · 3 voices · 7 citations
#cs.CL #cs.AI #cs.LG
- Proximity-Informed Calibration for Deep Neural Networks
2023/06/07 by Miao Xiong, Xiong, Miao, Ailin Deng +11 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training
2023/05/20 by Jieyu Zhang, Zhang, Jieyu, Bohan Wang +7 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification
- A False Sense of Privacy: Evaluating Textual Data Sanitization Beyond Surface-level Privacy Leakage
2025/04/28 by Rui Xin, Niloofar Mireshghallah, Xin, Rui +15 · 2 citations
Computer Science · Social Sciences · #Advanced Malware Detection Techniques #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
- The Delta Learning Hypothesis: Preference Tuning on Weak Data can Yield Strong Gains
2025/07/08 by Scott Geng, Geng, Scott, Hamish Ivison +11 · 3 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification