William Merrill

1. Let's Think Dot by Dot: Hidden Computation in Transformer Language Models
   2024/04/24 by Jacob Pfau, Pfau, Jacob, William Merrill +3 · 6 voices · 52 citations
   #cs.CL #cs.AI
2. The Illusion of State in State-Space Models
   2024/04/12 by William Merrill, Jackson Petty, Merrill, William +3 · 3 voices · 48 citations
   Computer Science · #Topic Modeling #Machine Learning in Healthcare #Adversarial Robustness in Machine Learning
3. 2 OLMo 2 Furious
   2024/12/31 by Team OLMo, P N Walsh, Pete Walsh +85 · 9 voices · 86 citations
   Computer Science · Medicine · #Topic Modeling #Artificial Intelligence in Healthcare and Education #Natural Language Processing Techniques
4. The Expressive Power of Transformers with Chain of Thought
   2023/10/11 by William Merrill, Ashish Sabharwal, Merrill, William +1 · 2 voices · 44 citations
   Computer Science · #Scientific Research and Philosophical Inquiry
5. Humanity's Last Exam
   2025/01/24 by Long Phan, Alice Gatti, Phan, Long +2240 · 9 voices · 106 citations
   #cs.LG #cs.AI #cs.CL
6. OLMo: Accelerating the Science of Language Models
   2024/02/01 by Dirk Groeneveld, Iz Beltagy, Groeneveld, Dirk +83 · 76 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques
7. How Language Model Hallucinations Can Snowball
   2023/05/22 by Muru Zhang, Ofir Press, Zhang, Muru +7 · 35 citations
   Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Healthcare #Topic Modeling
8. The Parallelism Tradeoff: Limitations of Log-Precision Transformers
   2022/07/02 by William Merrill, Ashish Sabharwal, Merrill, William +1 · 22 citations
   Computer Science · Engineering · #Machine Learning and Algorithms #Ferroelectric and Negative Capacitance Devices #Neural Networks and Applications
9. ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension
   2022/04/12 by Sanjay Subramanian, William Merrill, Subramanian, Sanjay +9 · 8 citations
   Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Speech and dialogue systems
10. A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers
    2025/03/05 by William Merrill, Ashish Sabharwal, Merrill, William +1 · 19 citations
    Computer Science · Engineering · #Computational Complexity (cs.CC) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
11. A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks
    2023/03/21 by William Merrill, Merrill, William, Nikolaos Tsilivis +3 · 5 citations
    Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Neural dynamics and brain function
12. Competency Problems: On Finding and Removing Artifacts in Language Data
    2021/04/17 by Matt Gardner, Gardner, Matt, William Merrill +11 · 3 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Explainable Artificial Intelligence (XAI)
13. Extracting Finite Automata from RNNs Using State Merging
    2022/01/28 by William Merrill, Merrill, William, Nikolaos Tsilivis +1 · 3 citations
    Computer Science · Engineering · #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning and Algorithms #Topic Modeling
14. Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment
    2024/02/21 by William Merrill, Merrill, William, Zhaofeng Wu +7 · 1 voice · 2 citations
    Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
15. Comparing Transformers and Hybrid Models at the Token Level
    2026/06/18 by Yanhong Li, William Merrill · 2 voices
    #cs.CL #cs.AI
16. Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training
    2025/05/29 by William Merrill, Merrill, William, Shane Arora +5 · 5 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
17. Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG
    2024/06/18 by William Merrill, Noah A. Smith, Merrill, William +3 · 2 citations
    Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language and cultural evolution #Natural Language Processing Techniques #Topic Modeling
18. Transparency Helps Reveal When Language Models Learn Meaning
    2022/10/14 by Zhaofeng Wu, Wu, Zhaofeng, William Merrill +7 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
19. On the Linguistic Capacity of Real-Time Counter Automata
    2020/04/15 by William Merrill, Merrill, William · 1 citation
    Engineering · Computer Science · #Ferroelectric and Negative Capacitance Devices #Natural Language Processing Techniques #Machine Learning and Algorithms
20. The Transformer Cookbook
    2025/10/01 by Andy Yang, Christopher Watson, Yang, Andy +15 · 1 voice · 1 citation
    #cs.LG