Yonatan Belinkov
- LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations
2024/10/03 by Hadas Orgad, Orgad, Hadas, Michael Toker +11 · 10 voices · 57 citations
Computer Science · Economics, Econometrics and Finance · Business, Management and Accounting · #Blockchain Technology Applications and Security #Credit Risk and Financial Regulations #Corporate Insolvency and Governance
- Jamba: A Hybrid Transformer-Mamba Language Model
2024/03/28 by Opher Lieber, Lieber, Opher, Barak Lenz +42 · 4 voices · 57 citations
Arts and Humanities · Social Sciences · #Language, Discourse, Communication Strategies #Multilingual Education and Policy
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
2022/06/09 by Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 · 3 voices · 143 citations
#cs.CL #cs.AI #cs.CY #cs.LG #stat.ML
- Locating and Editing Factual Associations in GPT
2022/02/10 by Kevin Meng, Meng, Kevin, David Bau +5 · 342 citations
Computer Science · #Topic Modeling #Explainable Artificial Intelligence (XAI) #Text Readability and Simplification
- Probing Classifiers: Promises, Shortcomings, and Advances
2021/02/24 by Yonatan Belinkov, Belinkov, Yonatan · 96 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7
- Mass-Editing Memory in a Transformer
2022/10/13 by Kevin Meng, Meng, Kevin, Arnab Sen Sharma +7 · 118 citations
Computer Science · Decision Sciences · #Topic Modeling #Advanced Data Storage Technologies #Scientific Computing and Data Management
- Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristics
2024/10/28 by Yaniv Nikankin, Anja Reusch, Nikankin, Yaniv +5 · 11 voices · 14 citations
Computer Science · #Computability, Logic, AI Algorithms
- Unified Concept Editing in Diffusion Models
2023/08/25 by Rohit Gandikota, Hadas Orgad, Gandikota, Rohit +7 · 66 citations
Computer Science · #Multimodal Machine Learning Applications #Generative Adversarial Networks and Image Synthesis #Internet Traffic Analysis and Secure E-voting
- Analyzing the Structure of Attention in a Transformer Language Model
2019/06/07 by Jesse Vig, Yonatan Belinkov, Vig, Jesse +1 · 1 voice · 19 citations
Computer Science · Mathematics · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.CL #cs.LG #stat.ML
- Distinguishing Ignorance from Error in LLM Hallucinations
2024/10/29 by Adi Simhi, Simhi, Adi, Jonathan Herzig +5 · 4 voices · 5 citations
#cs.CL
- Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks
2016/08/15 by Yossi Adi, Einat Kermany, Adi, Yossi +7 · 18 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hate Speech and Cyberbullying Detection #Natural Language Processing Techniques #Topic Modeling
- MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
2022/05/01 by Ehud Karpas, Omri Abend, Karpas, Ehud +31 · 24 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #AI-based Problem Solving and Planning
- Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias
2020/04/26 by Jesse Vig, Sebastian Gehrmann, Vig, Jesse +10 · 21 citations
Computer Science · #68T50 #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #I.2.7 #Topic Modeling
- Causal Analysis of Syntactic Agreement Mechanisms in Neural Language\n Models
2021/06/10 by Matthew Finlayson, Aaron Mueller, Finlayson, Matthew +9 · 15 citations
Computer Science · #68T50 #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms
2024/03/26 by Michael Hanna, Sandro Pezzelle, Hanna, Michael +3 · 26 citations
Business, Management and Accounting · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Islamic Finance and Banking Studies #Machine Learning (cs.LG) #Religion, Society, and Development
- Editing Implicit Assumptions in Text-to-Image Diffusion Models
2023/03/14 by Hadas Orgad, Bahjat Kawar, Orgad, Hadas +3 · 16 citations
Computer Science · #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- The Quest for the Right Mediator: Surveying Mechanistic Interpretability Through the Lens of Causal Mediation Analysis
2024/08/02 by Aaron Mueller, Mueller, Aaron, Jannik Brinkmann +25 · 3 voices · 14 citations
Computer Science · Social Sciences · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #European and International Law Studies #FOS: Computer and information sciences #Machine Learning (cs.LG) #Qualitative Comparative Analysis Research #cs.AI #cs.LG
- Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Bias
2023/08/01 by Itay Itzhak, Itzhak, Itay, Gabriel Stanovsky +5 · 15 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Text Readability and Simplification
- Confidence Regulation Neurons in Language Models
2024/06/24 by Alessandro Stolfo, Stolfo, Alessandro, Ben Wu +11 · 18 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking
2024/02/22 by N. Prakash, Tamar Rott Shaham, Prakash, Nikhil +7 · 16 citations
Computer Science · #Data Stream Mining Techniques
- Measuring Chain of Thought Faithfulness by Unlearning Reasoning Steps
2025/02/20 by Martin Tutek, Tutek, Martin, Fateme Hashemi Chaleshtori +5 · 2 voices · 12 citations
Social Sciences · #Education and Islamic Studies #Religion, Spirituality, and Psychology #cs.CL
- Identifying and Controlling Important Neurons in Neural Machine Translation
2018/11/03 by Anthony Bau, Yonatan Belinkov, Bau, Anthony +9 · 13 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Answer, Assemble, Ace: Understanding How LMs Answer Multiple Choice Questions
2024/07/21 by Sarah Wiegreffe, Oyvind Tafjord, Wiegreffe, Sarah +7 · 1 voice · 12 citations
Neuroscience · Psychology · Arts and Humanities · #Cognitive Science and Education Research #Language, Metaphor, and Cognition #Discourse Analysis in Language Studies
- Parallel Context Windows for Large Language Models
2022/12/21 by Nir Ratner, Ratner, Nir, Yoav Levine +16 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Trust Me, I'm Wrong: LLMs Hallucinate with Certainty Despite Knowing the Answer
2025/02/18 by Adi Simhi, Itay Itzhak, Simhi, Adi +7 · 1 voice · 14 citations
Computer Science · Neuroscience · #Blockchain Technology Applications and Security #Hallucinations in medical conditions #cs.CL
- Language Models use Lookbacks to Track Beliefs
2025/05/20 by Nikhil Prakash, Prakash, Nikhil, Natalie Shapira +13 · 4 voices · 9 citations
#cs.CL
- SAEs Are Good for Steering -- If You Select the Right Features
2025/05/26 by Dana Arad, Aaron Mueller, Arad, Dana +3 · 1 voice · 17 citations
Engineering · #cs.LG #cs.AI #cs.CL
- Generating Benchmarks for Factuality Evaluation of Language Models
2023/07/13 by Dor Muhlgay, Muhlgay, Dor, Ori Ram +17 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis
2023/01/01 by Alessandro Stolfo, Yonatan Belinkov, Mrinmaya Sachan · 1 voice · 4 citations
Computer Science · #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- Analyzing Phonetic and Graphemic Representations in End-to-End Automatic\n Speech Recognition
2019/07/09 by Yonatan Belinkov, Ahmed Ali, Belinkov, Yonatan +3 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #I.2.7 #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
2024/08/22 by Jamba Team, Barak Lenz, Lenz, Barak +113 · 7 citations
Engineering · Materials Science · #Fluid Dynamics and Vibration Analysis #High voltage insulation and dielectric phenomena #Power Transformer Diagnostics and Insulation
- VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers
2023/05/22 by Shahar Katz, Yonatan Belinkov, Katz, Shahar +1 · 4 citations
Computer Science · Materials Science · #Explainable Artificial Intelligence (XAI) #Topic Modeling #Machine Learning in Materials Science
- What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
2022/12/20 by Ori Ram, Ram, Ori, Liat Bezalel +9 · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Topic Modeling
- Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions
2022/07/28 by Yanai Elazar, Elazar, Yanai, Nora Kassner +15 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
- Debiasing Methods in Natural Language Understanding Make Bias More\n Accessible
2021/09/09 by Michael Mendelson, Mendelson, Michael, Yonatan Belinkov +1 · 2 citations
Computer Science · #68T50 #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #I.2.7 #Natural Language Processing Techniques #Topic Modeling
- On Evaluating the Generalization of LSTM Models in Formal Languages
2018/11/02 by Mirac Süzgün, Yonatan Belinkov, Suzgun, Mirac +3 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Algorithms
- Memory-Augmented Recurrent Neural Networks Can Learn Generalized Dyck Languages
2019/11/08 by Mirac Süzgün, Sebastian Gehrmann, Suzgun, Mirac +5 · 3 citations
Computer Science · Social Sciences · #Music and Audio Processing #Natural Language Processing Techniques #Language and cultural evolution
- BLIND: Bias Removal With No Demographics
2022/12/20 by Hadas Orgad, Orgad, Hadas, Yonatan Belinkov +1 · 2 citations
Computer Science · #68T50 #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Machine Learning in Healthcare #Topic Modeling
- MIB: A Mechanistic Interpretability Benchmark
2025/04/17 by Aaron Mueller, Mueller, Aaron, Atticus Geiger +45 · 1 voice · 6 citations
Computer Science · #Adversarial Robustness in Machine Learning #Explainable Artificial Intelligence (XAI) #Topic Modeling #cs.AI #cs.CL #cs.LG
- Learning from others' mistakes: Avoiding dataset biases without modeling them
2020/12/02 by Victor Sanh, Sanh, Victor, Thomas Wolf +5 · 1 citation
Computer Science · Social Sciences · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Padding Tone: A Mechanistic Analysis of Padding Tokens in T2I Models
2025/01/12 by Michael Toker, Toker, Michael, Ido Galil +11 · 3 citations
Engineering · Neuroscience · #Architecture and Computational Design #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Modular Robots and Swarm Intelligence #Tactile and Sensory Interactions
- Position-aware Automatic Circuit Discovery
2025/02/07 by Tal Haklay, Haklay, Tal, Hadas Orgad +7 · 3 citations
Computer Science · #68T50 #Advanced Database Systems and Queries #Algorithms and Data Compression #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Logic, programming, and type systems #Machine Learning (cs.LG)
- Old Habits Die Hard: How Conversational History Geometrically Traps LLMs
2026/02/08 by Adi Simhi, Fazl Barez, Martin Tutek +2 · 4 voices · 1 citation
#cs.CL #cs.AI
- Accelerating the Global Aggregation of Local Explanations
2023/12/13 by Alon Mor, Yonatan Belinkov, Mor, Alon +3 · 1 citation
Computer Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Structured RAG for Answering Aggregative Questions
2025/11/11 by Omri Koshorek, Koshorek, Omri, Niv Granot +14 · 1 citation
Computer Science · #Topic Modeling #Information Retrieval and Search Behavior #Multimodal Machine Learning Applications