vix.ing · top · new · best · stats · spec

Koh, Pang Wei

  1. On the Opportunities and Risks of Foundation Models
    2021/08/16 by Rishi Bommasani, Drew A. Hudson, Bommasani, Rishi +233 · 11 voices · 527 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #Topic Modeling
  2. 2 OLMo 2 Furious
    2024/12/31 by Team OLMo, OLMo, Team, P N Walsh +85 · 9 voices · 85 citations
    Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques
  3. Understanding Black-box Predictions via Influence Functions
    2017/03/14 by Koh, Pang Wei, Liang, Percy · 190 citations
    #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  4. The Generative AI Paradox: "What It Can Create, It May Not Understand"
    2023/10/31 by Peter West, West, Peter, Ximing Lu +27 · 5 voices · 13 citations
    Computer Science · Social Sciences · Medicine · #cs.AI #cs.CL #cs.CV #cs.LG
  5. Concept Bottleneck Models
    2020/07/09 by Pang Wei Koh, Koh, Pang Wei, Thao Nguyen +11 · 131 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Machine Learning in Bioinformatics #Metabolomics and Mass Spectrometry Studies #Machine Learning in Healthcare
  6. DataComp-LM: In search of the next generation of training sets for language models
    2024/06/17 by Jeffrey Li, Alex Fang, Li, Jeffrey +121 · 2 voices · 78 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
  7. Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization
    2019/11/20 by Shiori Sagawa, Pang Wei Koh, Sagawa, Shiori +5 · 126 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
  8. FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
    2023/05/23 by Sewon Min, Min, Sewon, Kalpesh Krishna +15 · 143 citations
    Computer Science · Social Sciences · #Topic Modeling #Natural Language Processing Techniques #Computational and Text Analysis Methods
  9. WILDS: A Benchmark of in-the-Wild Distribution Shifts
    2020/12/14 by Pang Wei Koh, Koh, Pang Wei, Shiori Sagawa +43 · 92 citations
    Computer Science · Medicine · #AI in cancer detection #COVID-19 diagnosis using AI #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
  10. Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
    2020/04/15 by Miles Brundage, Brundage, Miles, Shahar Avin +115 · 2 voices · 21 citations
    #cs.CY
  11. DataComp: In search of the next generation of multimodal datasets
    2023/04/27 by Samir Yitzhak Gadre, Gadre, Samir Yitzhak, Gabriel Ilharco +65 · 76 citations
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning in Healthcare #Topic Modeling
  12. Just Train Twice: Improving Group Robustness without Training Group\n Information
    2021/07/19 by Evan Liu, Liu, Evan Zheran, Behzad Haghgoo +15 · 38 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Reinforcement Learning in Robotics
  13. OLMoE: Open Mixture-of-Experts Language Models
    2024/09/03 by Niklas Muennighoff, Luca Soldaini, Muennighoff, Niklas +45 · 1 voice · 60 citations
    Computer Science · #Expert finding and Q&A systems #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
  14. OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models
    2023/08/02 by Anas Awadalla, Awadalla, Anas, Irena Gao +29 · 49 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques
  15. On the Accuracy of Influence Functions for Measuring Group Effects
    2019/05/30 by Pang Wei Koh, Kai-Siang Ang, Koh, Pang Wei +5 · 18 citations
    Computer Science · Social Sciences · Decision Sciences · #Advanced Statistical Modeling Techniques #Computational and Text Analysis Methods #Psychometric Methodologies and Testing
  16. Are aligned neural networks adversarially aligned?
    2023/06/26 by Carlini, Nicholas, Nasr, Milad, Choquette-Choo, Christopher A. +8 · 26 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  17. Certified Defenses for Data Poisoning Attacks
    2017/06/09 by Jacob Steinhardt, Steinhardt, Jacob, Pang Wei Koh +3 · 15 citations
    Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Security and Intrusion Detection
  18. An Investigation of Why Overparameterization Exacerbates Spurious Correlations
    2020/05/09 by Shiori Sagawa, Aditi Raghunathan, Sagawa, Shiori +5 · 17 citations
    Computer Science · #Reinforcement Learning in Robotics #Machine Learning and Data Classification #Evolutionary Algorithms and Applications
  19. MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoning
    2024/06/03 by Shuyue Stella Li, Vidhisha Balachandran, Li, Shuyue Stella +11 · 27 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Biomedical Text Mining and Ontologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling
  20. Accuracy on the Line: On the Strong Correlation Between\n Out-of-Distribution and In-Distribution Generalization
    2021/07/09 by J. J. Miller, Miller, John, Rohan Taori +15 · 12 citations
    Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
  21. Spurious Rewards: Rethinking Training Signals in RLVR
    2025/06/12 by Rulin Shao, Shuyue Stella Li, Shao, Rulin +25 · 58 citations
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
  22. Scaling Retrieval-Based Language Models with a Trillion-Token Datastore
    2024/07/09 by Shao, Rulin, He, Jacqueline, Asai, Akari +5 · 17 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
  23. JPEG-LM: LLMs as Image Generators with Canonical Codec Representations
    2024/08/15 by Xiaochuang Han, Han, Xiaochuang, Marjan Ghazvininejad +5 · 2 voices · 1 citation
    Computer Science · #Advanced Computational Techniques and Applications #cs.CL #cs.CV #cs.LG
  24. Instructional Fingerprinting of Large Language Models
    2024/01/21 by Jiashu Xu, Fei Wang, Xu, Jiashu +9 · 13 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
  25. Language models scale reliably with over-training and on downstream tasks
    2024/03/13 by Samir Yitzhak Gadre, Georgios Smyrnis, Gadre, Samir Yitzhak +45 · 12 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  26. OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
    2024/11/21 by Akari Asai, Jacqueline He, Asai, Akari +50 · 2 voices · 13 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Biomedical Text Mining and Ontologies #Natural Language Processing Techniques #Semantic Web and Ontologies #cs.AI #cs.CL #cs.DL #cs.IR #cs.LG
  27. ReasonIR: Training Retrievers for Reasoning Tasks
    2025/04/29 by Shao, Rulin, Qiao, Rui, Kishore, Varsha +8 · 28 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG)
  28. OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens
    2025/04/09 by Jiacheng Liu, Taylor Blanton, Liu, Jiacheng +61 · 3 voices · 8 citations
    Computer Science · Medicine · #Topic Modeling #Natural Language Processing Techniques #Artificial Intelligence in Healthcare and Education
  29. Extending the WILDS Benchmark for Unsupervised Adaptation
    2021/12/09 by Sagawa, Shiori, Koh, Pang Wei, Lee, Tony +17 · 6 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  30. Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulations
    2019/09/14 by Birnbaum, Sawyer, Kuleshov, Volodymyr, Enam, Zayd +2 · 4 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  31. Annotation alignment: Comparing LLM and human annotations of conversational safety
    2024/06/10 by Movva, Rajiv, Koh, Pang Wei, Pierson, Emma · 8 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  32. The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better
    2024/06/07 by Scott Geng, Geng, Scott, Cheng-Yu Hsieh +11 · 8 citations
    Medicine · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Surgical Simulation and Training
  33. Establishing Task Scaling Laws via Compute-Efficient Model Ladders
    2024/12/05 by Bhagia, Akshita, Liu, Jiacheng, Wettig, Alexander +9 · 9 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  34. DataDecide: How to Predict Best Pretraining Data with Small Experiments
    2025/04/15 by Ian Magnusson, Magnusson, Ian, Tai, Nguyen +22 · 12 citations
    Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
  35. Out-of-Domain Robustness via Targeted Augmentations
    2023/02/23 by Irena Gao, Shiori Sagawa, Gao, Irena +7 · 4 citations
    Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG)
  36. Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models
    2024/02/05 by Zhiyuan Hu, Hu, Zhiyuan, Chumin Liu +15 · 5 citations
    Computer Science · #Topic Modeling
  37. Reliable, Adaptable, and Attributable Language Models with Retrieval
    2024/03/05 by Asai, Akari, Zhong, Zexuan, Chen, Danqi +4 · 5 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  38. Multilingual Diversity Improves Vision-Language Representations
    2024/05/27 by Thao D. Nguyen, Nguyen, Thao, Matthew Wallingford +13 · 5 citations
    Arts and Humanities · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Media, Religion, Digital Communication
  39. CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation
    2024/07/09 by Tong Chen, Chen, Tong, Akari Asai +15 · 6 citations
    Computer Science · #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG)
  40. Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time
    2022/11/25 by Yao, Huaxiu, Choi, Caroline, Cao, Bochuan +3 · 3 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  41. Exploring How Generative MLLMs Perceive More Than CLIP with the Same Vision Encoder
    2024/11/07 by Siting Li, Li, Siting, Pang Wei Koh +3 · 6 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Digital Image Processing Techniques #FOS: Computer and information sciences #Genomic variations and chromosomal abnormalities #Machine Learning (cs.LG) #graph theory and CDMA systems
  42. ICONS: Influence Consensus for Vision-Language Data Selection
    2024/12/31 by Xindi Wu, Mengzhou Xia, Wu, Xindi +9 · 7 citations
    Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Advanced Image and Video Retrieval Techniques
  43. Selective Classification Can Magnify Disparities Across Groups
    2020/10/27 by Jones, Erik, Sagawa, Shiori, Koh, Pang Wei +2 · 2 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  44. PLeaS -- Merging Models with Permutations and Least Squares
    2024/07/02 by Anshul Nasery, Jonathan Hayase, Nasery, Anshul +5 · 4 citations
    Business, Management and Accounting · #Business Strategy and Innovation #FOS: Computer and information sciences #Machine Learning (cs.LG)
  45. Improving Domain Generalization with Domain Relations
    2023/02/06 by Huaxiu Yao, Yao, Huaxiu, Xinyu Yang +9 · 2 citations
    Biochemistry, Genetics and Molecular Biology · Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Bioinformatics #Topic Modeling
  46. DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research
    2025/11/24 by Shao, Rulin, Asai, Akari, Shen, Shannon Zejiang +18 · 7 citations
    Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare
  47. S4S: Solving for a Diffusion Model Solver
    2025/02/24 by E. T. Frankel, Sitan Chen, Frankel, Eric +9 · 4 citations
    Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Numerical methods for differential equations
  48. Large-Scale Data Selection for Instruction Tuning
    2025/03/03 by Ivison, Hamish, Zhang, Muru, Brahman, Faeze +2 · 4 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  49. Fluid Language Model Benchmarking
    2025/09/14 by Valentin Hofmann, David Heineman, Hofmann, Valentin +17 · 3 voices · 7 citations
    #cs.CL #cs.AI #cs.LG
  50. FlexOlmo: Open Language Models for Flexible Data Use
    2025/07/09 by Shi, Weijia, Bhagia, Akshita, Farhat, Kevin +20 · 6 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  51. EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
    2025/03/11 by Zeng, Zhiyuan, Wang, Yizhong, Hajishirzi, Hannaneh +1 · 4 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  52. Frustratingly Simple Retrieval Improves Challenging, Reasoning-Intensive Benchmarks
    2025/07/02 by Lyu, Xinxi, Duan, Michael, Shao, Rulin +2 · 4 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
  53. Proximity-Informed Calibration for Deep Neural Networks
    2023/06/07 by Miao Xiong, Ailin Deng, Xiong, Miao +11 · 1 citation
    Computer Science · #Adversarial Robustness in Machine Learning #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  54. On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training
    2023/05/20 by Jieyu Zhang, Zhang, Jieyu, Bohan Wang +7 · 1 citation
    Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification
  55. Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions
    2025/03/10 by Qiao, Rui, Wu, Zhaoxuan, Wang, Jingtan +2 · 3 citations
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  56. Precise Information Control in Long-Form Text Generation
    2025/06/06 by He, Jacqueline, Yen, Howard, Li, Margaret +7 · 3 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  57. Using large language models to promote health equity
    2023/12/22 by Pierson, Emma, Shanmugam, Divya, Movva, Rajiv +12 · 1 citation
    #Computers and Society (cs.CY) #FOS: Computer and information sciences
  58. Information-Theoretic Distillation for Reference-less Summarization
    2024/03/20 by Jung, Jaehun, Lu, Ximing, Jiang, Liwei +4 · 1 citation
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  59. A False Sense of Privacy: Evaluating Textual Data Sanitization Beyond Surface-level Privacy Leakage
    2025/04/28 by Rui Xin, Xin, Rui, Niloofar Mireshghallah +15 · 2 citations
    Computer Science · Social Sciences · #Advanced Malware Detection Techniques #Computation and Language (cs.CL) #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data
  60. The Delta Learning Hypothesis: Preference Tuning on Weak Data can Yield Strong Gains
    2025/07/08 by Scott Geng, Geng, Scott, Hamish Ivison +11 · 3 citations
    Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
  61. Negative Token Merging: Image-based Adversarial Feature Guidance
    2024/12/02 by Singh, Jaskirat, Li, Lindsey, Shi, Weijia +7 · 1 citation
    #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG) #Machine Learning (stat.ML)
  62. Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
    2024/10/16 by Morrison, Jacob, Smith, Noah A., Hajishirzi, Hannaneh +3 · 1 citation
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)