Bowman, Samuel R.
- AI Supported Degradation of the Self Concept: A Theoretical Framework Grounded in Established Cognitive and Computational Mechanisms
2023/10/20 by Mrinank Sharma, Sharma, Mrinank, Meg Tong +36 · 10 voices · 226 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #Reinforcement Learning in Robotics #Topic Modeling #cs.AI #cs.CL #cs.LG #stat.ML
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
2024/01/10 by Evan Hubinger, Carson Denison, Hubinger, Evan +77 · 18 voices · 99 citations
Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Ethics and Social Impacts of AI #Topic Modeling #cs.AI #cs.CL #cs.CR #cs.LG #cs.SE
- Affective Coherence Monitoring for Transformer-Based Language Models
2022/12/15 by Yuntao Bai, Saurav Kadavath, Bai, Yuntao +102 · 12 voices · 444 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #cs.AI #cs.CL
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
2023/11/20 by David Rein, David B. Rein, Rein, David +14 · 12 voices · 687 citations
Computer Science · #cs.AI #cs.CL
- Let's Think Dot by Dot: Hidden Computation in Transformer Language Models
2024/04/24 by Jacob Pfau, Pfau, Jacob, William Merrill +3 · 6 voices · 52 citations
#cs.CL #cs.AI
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
2018/04/20 by Wang, Alex, Singh, Amanpreet, Michael, Julian +3 · 372 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Reasoning Models Don't Always Say What They Think
2025/05/08 by Yanda Chen, Joe Benton, Chen, Yanda +27 · 6 voices · 94 citations
Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #cs.AI #cs.CL #cs.LG
- Kronfluence: Influence Functions with Eigenvalue-corrected Kronecker-Factored Approximate Curvature
2023/08/07 by Roger Grosse, Grosse, Roger, Juhan Bae +31 · 3 voices · 49 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- A large annotated corpus for learning natural language inference
2015/08/21 by Samuel R. Bowman, Bowman, Samuel R., Gabor Angeli +5 · 167 citations
Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Natural Language Processing Techniques
- A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
2017/04/18 by Williams, Adina, Nangia, Nikita, Bowman, Samuel R. · 135 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Alignment faking in large language models
2024/12/18 by Ryan Greenblatt, Carson Denison, Greenblatt, Ryan +38 · 16 voices · 64 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
2019/05/02 by Alex Wang, Wang, Alex, Yada Pruksachatkun +13 · 143 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting
2023/05/07 by Miles Turpin, Julian Michael, Turpin, Miles +5 · 208 citations
Computer Science · Materials Science · #Topic Modeling #Explainable Artificial Intelligence (XAI) #Machine Learning in Materials Science
- LLM Evaluators Recognize and Favor Their Own Generations
2024/04/15 by Arjun Panickssery, Panickssery, Arjun, Samuel R. Bowman +3 · 4 voices · 97 citations
#cs.CL #cs.AI
- Measuring Faithfulness in Chain-of-Thought Reasoning
2023/07/17 by Tamera Lanham, Lanham, Tamera, Anna Chen +59 · 4 voices · 82 citations
Computer Science · #Advanced Graph Neural Networks #Explainable Artificial Intelligence (XAI) #Topic Modeling #cs.AI #cs.CL #cs.LG
- BBQ: A Hand-Built Bias Benchmark for Question Answering
2021/10/15 by Alicia Parrish, Parrish, Alicia, Angelica Chen +13 · 104 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques #Topic Modeling
- Discovering Language Model Behaviors with Model-Written Evaluations
2022/12/19 by Ethan Perez, Perez, Ethan, Sam Ringer +123 · 120 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
- BLiMP: The Benchmark of Linguistic Minimal Pairs for English
2019/12/02 by Warstadt, Alex, Parrish, Alicia, Liu, Haokun +4 · 73 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Language Models Learn to Mislead Humans via RLHF
2024/09/19 by Jiaxin Wen, Ruiqi Zhong, Wen, Jiaxin +15 · 8 voices · 18 citations
Computer Science · #Adversarial Robustness in Machine Learning #Topic Modeling
- Eight Things to Know about Large Language Models
2023/04/02 by Samuel R. Bowman, Bowman, Samuel R. · 4 voices · 8 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Social Media and Politics #cs.AI #cs.CL
- XNLI: Evaluating Cross-lingual Sentence Representations
2018/09/13 by Alexis Conneau, Conneau, Alexis, Guillaume Lample +11 · 65 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Neural Network Acceptability Judgments
2018/05/31 by Warstadt, Alex, Singh, Amanpreet, Bowman, Samuel R. · 55 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
2020/09/30 by Nangia, Nikita, Vania, Clara, Bhalerao, Rasika +1 · 62 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Pretraining Language Models with Human Preferences
2023/02/16 by Tomasz Korbak, Kejian Shi, Korbak, Tomasz +13 · 1 voice · 17 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.LG
- On Measuring Social Biases in Sentence Encoders
2019/03/25 by May, Chandler, Wang, Alex, Bordia, Shikha +2 · 35 citations
#Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences
- Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming
2025/01/31 by Mrinank Sharma, Sharma, Mrinank, Meg Tong +89 · 8 voices · 36 citations
Social Sciences · #Criminal Law and Evidence #Law, Rights, and Freedoms #Legal Systems and Judicial Processes
- Debating with More Persuasive LLMs Leads to More Truthful Answers
2024/02/09 by Akbir Khan, John Hughes, Khan, Akbir +17 · 48 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #Law, AI, and Intellectual Property #Legal Education and Practice Innovations
- The Capacity for Moral Self-Correction in Large Language Models
2023/02/15 by Deep Ganguli, Amanda Askell, Ganguli, Deep +100 · 1 voice · 9 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Topic Modeling #cs.CL
- Annotation Artifacts in Natural Language Inference Data
2018/03/06 by Gururangan, Suchin, Swayamdipta, Swabha, Levy, Omer +3 · 16 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- What do you learn from context? Probing for sentence structure in contextualized word representations
2019/05/15 by Tenney, Ian, Xia, Patrick, Chen, Berlin +8 · 17 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- What Will it Take to Fix Benchmarking in Natural Language Understanding?
2021/04/05 by Bowman, Samuel R., Dahl, George E. · 18 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Measuring Progress on Scalable Oversight for Large Language Models
2022/11/04 by Samuel R. Bowman, Jeeyoon Hyun, Bowman, Samuel R. +88 · 21 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Multi-Agent Systems and Negotiation #Speech and dialogue systems #Topic Modeling
- Identifying and Reducing Gender Bias in Word-Level Language Models
2019/04/05 by Bordia, Shikha, Bowman, Samuel R. · 14 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Instruction Induction: From Few Examples to Natural Language Task Descriptions
2022/05/22 by Or Honovich, Uri Shaham, Honovich, Or +5 · 15 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning and Data Classification #Topic Modeling
- QuALITY: Question Answering with Long Input Texts, Yes!
2021/12/16 by Richard Yuanzhe Pang, Alicia Parrish, Pang, Richard Yuanzhe +19 · 14 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning
2017/04/23 by Yacine Jernite, Jernite, Yacine, Samuel R. Bowman +3 · 1 voice · 1 citation
#cs.CL #cs.LG #cs.NE #stat.ML
- Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models
2024/06/14 by Denison, Carson, MacDiarmid, Monte, Barez, Fazl +11 · 24 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- ListOps: A Diagnostic Dataset for Latent Tree Learning
2018/04/17 by Nangia, Nikita, Bowman, Samuel R. · 8 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- What Artificial Neural Networks Can Tell Us About Human Language Acquisition
2022/08/17 by Alex Warstadt, Samuel R. Bowman, Warstadt, Alex +1 · 8 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- Comparing Test Sets with Item Response Theory
2021/06/01 by Vania, Clara, Htut, Phu Mon, Huang, William +6 · 6 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Auditing language models for hidden objectives
2025/03/14 by Samuel Marks, Samuel D. Marks, Marks, Samuel +71 · 1 voice · 16 citations
Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #cs.AI #cs.CL #cs.LG
- Steering Without Side Effects: Improving Post-Deployment Control of Language Models
2024/06/21 by Asa Cooper Stickland, Alexander Lyzhov, Stickland, Asa Cooper +7 · 10 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Agent Systems and Negotiation #Natural Language Processing Techniques
- Can recursive neural tensor networks learn logical reasoning?
2013/12/21 by Samuel R. Bowman, Bowman, Samuel R. · 1 voice
#cs.CL #cs.LG
- SQuALITY: Building a Long-Document Summarization Dataset the Hard Way
2022/05/23 by Alex Wang, Richard Yuanzhe Pang, Wang, Alex +7 · 4 citations
Computer Science · #Advanced Text Analysis Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Question Decomposition Improves the Faithfulness of Model-Generated Reasoning
2023/07/17 by Ansh Radhakrishnan, Karina Nguyen, Radhakrishnan, Ansh +45 · 5 citations
Computer Science · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Bias-Augmented Consistency Training Reduces Biased Reasoning in Chain-of-Thought
2024/03/08 by James Chua, Chua, James, Edward Rees +11 · 6 citations
Decision Sciences · Computer Science · #Decision-Making and Behavioral Economics #AI in Service Interactions
- When Do You Need Billions of Words of Pretraining Data?
2020/11/10 by Zhang, Yian, Warstadt, Alex, Li, Haau-Sing +1 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- (QA)2: Question Answering with Questionable Assumptions
2022/12/20 by Najoung Kim, Phu Mon Htut, Kim, Najoung +5 · 4 citations
Computer Science · #Topic Modeling #Information Retrieval and Search Behavior #Expert finding and Q&A systems
- Improving Code Generation by Training with Natural Language Feedback
2023/03/28 by Chen, Angelica, Scheurer, Jérémy, Korbak, Tomasz +5 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE)
- Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions
2022/04/11 by Parrish, Alicia, Trivedi, Harsh, Perez, Ethan +4 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- What Do NLP Researchers Believe? Results of the NLP Community Metasurvey
2022/08/26 by Michael, Julian, Holtzman, Ari, Parrish, Alicia +8 · 3 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7
- Debate Helps Supervise Unreliable Experts
2023/11/15 by Julian Michael, Salsabila Mahdi, Michael, Julian +11 · 4 citations
Computer Science · #Expert finding and Q&A systems #Topic Modeling #Explainable Artificial Intelligence (XAI)
- Sabotage Evaluations for Frontier Models
2024/10/28 by Benton, Joe, Wagner, Misha, Christiansen, Eric +13 · 6 citations
#Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Verb Argument Structure Alternations in Word and Sentence Embeddings
2018/11/27 by Katharina Kann, Kann, Katharina, Alex Warstadt +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
2019/04/25 by Najoung Kim, Roma Patel, Kim, Najoung +21 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Do Attention Heads in BERT Track Syntactic Dependencies?
2019/11/27 by Htut, Phu Mon, Phang, Jason, Bordia, Shikha +1 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Can neural networks acquire a structural bias from raw linguistic data?
2020/07/14 by Alex Warstadt, Samuel R. Bowman, Warstadt, Alex +1 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Does Putting a Linguist in the Loop Improve NLU Data Collection?
2021/04/15 by Alicia Parrish, William C. Huang, Parrish, Alicia +17 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Mobile Crowdsensing and Crowdsourcing
- Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers
2021/09/17 by Phang, Jason, Liu, Haokun, Bowman, Samuel R. · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Two-Turn Debate Doesn't Help Humans Answer Hard Reading Comprehension Questions
2022/10/19 by Alicia Parrish, Harsh Trivedi, Parrish, Alicia +11 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation #Speech and dialogue systems #Topic Modeling
- A Fast Unified Model for Parsing and Sentence Understanding
2016/03/19 by Bowman, Samuel R., Gauthier, Jon, Rastogi, Abhinav +3 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- A Stable and Effective Learning Strategy for Trainable Greedy Decoding
2018/04/21 by Chen, Yun, Li, Victor O. K., Cho, Kyunghyun +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Tasks
2018/11/02 by Phang, Jason, Févry, Thibault, Bowman, Samuel R. · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Investigating BERT's Knowledge of Language: Five Analysis Methods with\n NPIs
2019/09/05 by Alex Warstadt, Yu Cao, Warstadt, Alex +29 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?
2020/05/01 by Yada Pruksachatkun, Jason Phang, Pruksachatkun, Yada +15 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)
2020/10/11 by Warstadt, Alex, Zhang, Yian, Li, Haau-Sing +2 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail
2021/10/15 by Bowman, Samuel R. · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Clean or Annotate: How to Spend a Limited Data Collection Budget
2021/10/15 by Chen, Derek, Yu, Zhou, Bowman, Samuel R. · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Spontaneous Reward Hacking in Iterative Self-Refinement
2024/07/05 by Jane Pan, He He, Pan, Jane +5 · 2 citations
Computer Science · Engineering · #Advanced Malware Detection Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Manufacturing Process and Optimization #Robot Manipulation and Learning
- Recursive Neural Networks Can Learn Logical Semantics
2014/06/06 by Samuel R. Bowman, Bowman, Samuel R., Christopher Potts +3 · 1 voice
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #cs.CL #cs.LG #cs.NE
- What Makes Reading Comprehension Questions Difficult?
2022/03/12 by Sugawara, Saku, Nangia, Nikita, Warstadt, Alex +1 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Can Unconditional Language Models Recover Arbitrary Sentences?
2019/07/10 by Nishant Subramani, Subramani, Nishant, Samuel R. Bowman +3 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling