Jacob Andreas
- The Surprising Effectiveness of Test-Time Training for Few-Shot Learning
2024/11/11 by Ekin Akyürek, Akyürek, Ekin, Mehul Damani +14 · 17 voices · 41 citations
Computer Science · #Intelligent Tutoring Systems and Adaptive Learning
- LoRA vs Full Fine-tuning: An Illusion of Equivalence
2024/10/28 by Reece Shuttleworth, Shuttleworth, Reece, Jacob Andreas +5 · 8 voices · 29 citations
Computer Science · Engineering · #Embedded Systems Design Techniques #Fault Detection and Control Systems #Parallel Computing and Optimization Techniques
- What learning algorithm is in-context learning? Investigations with linear models
2022/11/28 by Ekin Akyürek, Akyürek, Ekin, Dale Schuurmans +7 · 3 voices · 72 citations
Computer Science · #Neural Networks and Applications #cs.CL #cs.LG
- Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
2023/07/05 by Zhaofeng Wu, Linlu Qiu, Wu, Zhaofeng +15 · 8 voices · 38 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought
2023/06/22 by Lionel Wong, Wong, Lionel, Gabriel Grand +11 · 2 voices · 17 citations
#cs.CL #cs.AI #cs.SC
- Language Models Trained on Media Diets Can Predict Public Opinion
2023/03/28 by Eric Chu, Jacob Andreas, Chu, Eric +5 · 3 voices · 5 citations
Social Sciences · #Computational and Text Analysis Methods #Media Influence and Politics #Social Media and Politics #cs.CL #cs.LG
- A Multimodal Automated Interpretability Agent
2024/04/22 by Tamar Rott Shaham, Sarah Schwettmann, Shaham, Tamar Rott +11 · 2 voices · 12 citations
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #cs.AI #cs.CL #cs.CV
- Speaker-Follower Models for Vision-and-Language Navigation
2018/06/07 by Daniel Fried, Ronghang Hu, Fried, Daniel +17 · 27 citations
Computer Science · #Speech and dialogue systems #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Grokking of Hierarchical Structure in Vanilla Transformers
2023/05/30 by Shikhar Murty, Pratyusha Sharma, Murty, Shikhar +5 · 1 voice · 7 citations
Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling #cs.CL
- Modular Multitask Reinforcement Learning with Policy Sketches
2016/11/06 by Jacob Andreas, Dan Klein, Andreas, Jacob +3 · 14 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Reinforcement Learning in Robotics #Robot Manipulation and Learning #Software Engineering Research
- Guiding Pretraining in Reinforcement Learning with Large Language Models
2023/02/13 by Yuqing Du, Olivia Watkins, Du, Yuqing +13 · 24 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Pre-Trained Language Models for Interactive Decision-Making
2022/02/03 by Shuang Li, Xavier Puig, Li, Shuang +25 · 17 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Inspecting and Editing Knowledge Representations in Language Models
2023/04/03 by Evan Hernandez, Belinda Z. Li, Hernandez, Evan +3 · 20 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Compositional Explanations of Neurons
2020/06/24 by Jesse Mu, Mu, Jesse, Jacob Andreas +1 · 12 citations
Computer Science · Materials Science · #Explainable Artificial Intelligence (XAI) #Adversarial Robustness in Machine Learning #Machine Learning in Materials Science
- Decomposing Uncertainty for Large Language Models through Input Clarification Ensembling
2023/11/15 by Bairu Hou, Yujian Liu, Hou, Bairu +9 · 20 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Modeling Relationships in Referential Expressions with Compositional Modular Networks
2016/11/30 by Ronghang Hu, Hu, Ronghang, Marcus Rohrbach +7 · 15 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Human Pose and Action Recognition
- Towards Tracing Factual Knowledge in Language Models Back to the Training Data
2022/05/23 by Ekin Akyürek, Akyürek, Ekin, Tolga Bolukbasi +11 · 1 voice · 4 citations
Computer Science · Decision Sciences · #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Topic Modeling #cs.CL #cs.IR
- Natural Language Descriptions of Deep Visual Features
2022/01/26 by Evan Hernandez, Sarah Schwettmann, Hernandez, Evan +9 · 11 citations
Biochemistry, Genetics and Molecular Biology · #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Explaining Attention with Program Synthesis
2026/06/17 by Amiri Hayes, Belinda Z Li, Jacob Andreas · 6 voices
#cs.LG #cs.AI
- Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models
2024/05/15 by Anna A. Ivanova, Aalok Sathe, Ivanova, Anna A. +37 · 15 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- A Benchmark for Systematic Generalization in Grounded Language Understanding
2020/03/11 by Laura Ruis, Jacob Andreas, Ruis, Laura +7 · 7 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- In-Context Language Learning: Architectures and Algorithms
2024/01/23 by Ekin Akyürek, Akyürek, Ekin, Bailin Wang +5 · 11 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Learning How Hard to Think: Input-Adaptive Allocation of LM Computation
2024/10/07 by Mehul Damani, Damani, Mehul, Idan Shenfeld +7 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Neural Networks and Reservoir Computing
- Skill Induction and Planning with Latent Language
2021/10/04 by Pratyusha Sharma, Antonio Torralba, Sharma, Pratyusha +3 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Robotics (cs.RO) #Topic Modeling
- Correcting Robot Plans with Natural Language Feedback
2022/04/11 by Pratyusha Sharma, Balakumar Sundaralingam, Sharma, Pratyusha +13 · 6 citations
Computer Science · #Natural Language Processing Techniques #AI-based Problem Solving and Planning #Multimodal Machine Learning Applications
- Beyond Binary Rewards: Training LMs to Reason About Their Uncertainty
2025/07/22 by Mehul Damani, Isha Puri, Damani, Mehul +11 · 1 voice · 25 citations
Computer Science · #Intelligent Tutoring Systems and Adaptive Learning
- Learning to Compose Neural Networks for Question Answering
2016/01/07 by Jacob Andreas, Marcus Rohrbach, Andreas, Jacob +5 · 2 voices
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Neural and Evolutionary Computing (cs.NE) #cs.CL #cs.CV #cs.NE
- Measuring Compositionality in Representation Learning
2019/02/19 by Jacob Andreas, Andreas, Jacob · 6 citations
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language and cultural evolution #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Topic Modeling
- LILO: Learning Interpretable Libraries by Compressing and Documenting Code
2023/10/30 by Gabriel Grand, Lionel Wong, Grand, Gabriel +9 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Programming Languages (cs.PL) #Software Engineering Research #Topic Modeling
- The Consensus Game: Language Model Generation via Equilibrium Search
2023/10/13 by Athul Paul Jacob, Yikang Shen, Jacob, Athul Paul +5 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- PromptBoosting: Black-Box Text Classification with Ten Forward Passes
2022/12/19 by Bairu Hou, Joe O’Connor, Hou, Bairu +7 · 4 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- Cognitive Dissonance: Why Do Language Model Outputs Disagree with Internal Representations of Truthfulness?
2023/11/27 by Kevin Liu, Stephen Casper, Liu, Kevin +5 · 5 citations
Computer Science · Medicine · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Topic Modeling
- Subspace Regularizers for Few-Shot Class Incremental Learning
2021/10/13 by Afra Feyza Akyürek, Ekin Akyürek, Akyürek, Afra Feyza +6 · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Cancer-related molecular mechanisms research #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Learning adaptive planning representations with natural language guidance
2023/12/13 by Lionel Wong, Jiayuan Mao, Wong, Lionel +13 · 5 citations
Computer Science · #AI-based Problem Solving and Planning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Robotics (cs.RO) #Software Engineering Research #Topic Modeling
- A Probabilistic Framework for LLM Hallucination Detection via Belief Tree Propagation
2024/06/11 by Bairu Hou, Hou, Bairu, Yang Zhang +5 · 5 citations
Computer Science · #Computation and Language (cs.CL) #Digital Media Forensic Detection #FOS: Computer and information sciences
- Explainable Neural Computation via Stack Neural Module Networks
2018/07/23 by Ronghang Hu, Jacob Andreas, Hu, Ronghang +5 · 2 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Visual Grounding Helps Learn Word Meanings in Low-Data Regimes
2023/10/20 by Chengxu Zhuang, Zhuang, Chengxu, Evelina Fedorenko +3 · 1 voice · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Are Visual Explanations Useful? A Case Study in Model-in-the-Loop Prediction
2020/07/23 by Eric Chu, Chu, Eric, Deb Roy +3 · 2 citations
Computer Science · Social Sciences · #Explainable Artificial Intelligence (XAI) #Machine Learning and Data Classification #Ethics and Social Impacts of AI
- MisinfoEval: Generative AI in the Era of "Alternative Facts"
2024/10/13 by Saadia Gabriel, Gabriel, Saadia, Liang Lyu +9 · 5 citations
Social Sciences · #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences
- The Low-Dimensional Linear Geometry of Contextualized Word\n Representations
2021/05/14 by Evan Hernandez, Hernandez, Evan, Jacob Andreas +1 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research #Text Readability and Simplification #Topic Modeling
- Modeling Strong and Human-Like Gameplay with KL-Regularized Search
2021/12/14 by Athul Paul Jacob, Jacob, Athul Paul, David Wu +12 · 2 citations
Economics, Econometrics and Finance · Computer Science · #Sports Analytics and Performance #Reinforcement Learning in Robotics #Artificial Intelligence in Games
- Algorithmic Capabilities of Random Transformers
2024/10/06 by Ziqian Zhong, Jacob Andreas, Zhong, Ziqian +1 · 4 citations
Computer Science · #Neural Networks and Applications
- Loose LIPS Sink Ships: Asking Questions in Battleship with Language-Informed Program Sampling
2024/02/29 by Gabriel Grand, Valerio Pepe, Grand, Gabriel +5 · 4 citations
Health Professions · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Interpreting and Communication in Healthcare
- Automatic Discovery of Visual Circuits
2024/04/22 by Achyuta Rajaram, Neil Chowdhury, Rajaram, Achyuta +7 · 3 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Blind Source Separation Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection #Neural Networks and Applications
- Decision-Oriented Dialogue for Human-AI Collaboration
2023/05/31 by Jessy Lin, Lin, Jessy, Nicholas Tomlin +5 · 2 citations
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #Topic Modeling
- A Hitchhiker's Guide to Scaling Law Estimation
2024/10/15 by Leshem Choshen, Choshen, Leshem, Zhang, Yang +2 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Topic Modeling
- Translating Neuralese
2017/04/23 by Jacob Andreas, Andreas, Jacob, Anca D. Dragan +3 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE) #Reinforcement Learning in Robotics
- Modeling Boundedly Rational Agents with Latent Inference Budgets
2023/12/07 by Athul Paul Jacob, Abhishek Gupta, Jacob, Athul Paul +3 · 2 citations
Computer Science · Economics, Econometrics and Finance · #Artificial Intelligence (cs.AI) #Bayesian Modeling and Causal Inference #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Sports Analytics and Performance
- Assessing Adaptive World Models in Machines with Novel Games
2025/07/17 by Lance Ying, Ying, Lance, Katherine M. Collins +28 · 2 voices · 6 citations
Computer Science · #Artificial Intelligence in Games #Computability, Logic, AI Algorithms #Reinforcement Learning in Robotics #cs.AI #cs.LG
- Adaptive Language-Guided Abstraction from Contrastive Explanations
2024/09/12 by Andi Peng, Peng, Andi, Belinda Z. Li +11 · 3 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Robotics (cs.RO) #Semantic Web and Ontologies #Topic Modeling
- (How) Do Language Models Track State?
2025/03/04 by Belinda Z. Li, Li, Belinda Z., Jacob Andreas +2 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Cetacean Translation Initiative: a roadmap to deciphering the communication of sperm whales
2021/04/17 by Jacob Andreas, Andreas, Jacob, Gašper Beguš +37 · 1 citation
Biochemistry, Genetics and Molecular Biology · Earth and Planetary Sciences · Environmental Science · #Animal Vocal Communication and Behavior #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Marine animal studies overview #Robotics (cs.RO) #Sound (cs.SD) #Underwater Acoustics Research #electronic engineering #information engineering
- Pushdown Layers: Encoding Recursive Structure in Transformer Language Models
2023/10/29 by Shikhar Murty, Pratyusha Sharma, Murty, Shikhar +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- An Incomplete Loop: Instruction Inference, Instruction Following, and In-context Learning in Language Models
2024/04/03 by Emmy Liu, Graham Neubig, Liu, Emmy +3 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Characterizing Intrinsic Compositionality in Transformers with Tree Projections
2022/11/02 by Shikhar Murty, Murty, Shikhar, Pratyusha Sharma +5 · 1 citation
Computer Science · Neuroscience · #Natural Language Processing Techniques #Topic Modeling #Neurobiology of Language and Bilingualism
- Do LLMs Benefit From Their Own Words?
2026/02/27 by Jenny Y. Huang, Leshem Choshen, Ramon Astudillo +2 · 1 voice · 3 citations
#cs.CL #cs.AI
- Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting
2025/10/11 by Michael Y. Hu, Hu, Michael Y., Benjamin Van Durme +5 · 1 voice
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
- Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling
2024/03/21 by Chengxu Zhuang, Zhuang, Chengxu, Evelina Fedorenko +3 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Log-Augmented Generation: Scaling Test-Time Reasoning with Reusable Computation
2025/05/20 by Peter Baile Chen, Chen, Peter Baile, Yi Zhang +7 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Self-Steering Language Models
2025/04/09 by Gabriel Grand, Grand, Gabriel, Joshua B. Tenenbaum +7 · 2 citations
Computer Science · #Natural Language Processing Techniques
- Line of Sight: On Linear Representations in VLLMs
2025/06/05 by Achyuta Rajaram, Sarah Schwettmann, Rajaram, Achyuta +5 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Multimodal Machine Learning Applications #Topic Modeling
- Interpreting User Requests in the Context of Natural Language Standing Instructions
2023/11/16 by Nikita Moghe, Patrick Xia, Moghe, Nikita +9 · 1 voice · 1 citation
Computer Science · #cs.CL #cs.AI
- A Roadmap to Impactful Pluralistic Alignment Research
2026/07/24 by Elinor Poole-Dayan, Jillian Fisher, Atoosa Kasirzadeh +3
#cs.AI