Ryan Cotterell
- LEACE: Perfect linear concept erasure in closed form
2023/06/06 by Nora Belrose, Belrose, Nora, David Schneider-Joseph +9 · 1 voice · 31 citations
Computer Science · Social Sciences · #Machine Learning in Healthcare #Misinformation and Its Impacts #Topic Modeling #cs.CL #cs.CY #cs.LG
- Transformers are Inherently Succinct
2025/10/22 by Pascal Bergsträßer, Ryan Cotterell, Bergsträßer, Pascal +3 · 11 voices
Computer Science · #Formal Methods in Verification #Logic, programming, and type systems #semigroups and automata theory
- Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphology
2019/06/11 by Ran Zmigrod, Zmigrod, Ran, Hanna Wallach +4 · 16 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text
2023/05/22 by Wangchunshu Zhou, Zhou, Wangchunshu, Yuchen Eleanor Jiang +13 · 1 voice · 7 citations
Computer Science · Decision Sciences · #Advanced Data Storage Technologies #Scientific Computing and Data Management #Topic Modeling #cs.CL #cs.LG
- A Plug-and-Play Method for Controlled Text Generation
2021/09/20 by Damian Pascual, Pascual, Damian, Beni Egressy +7 · 2 voices · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.AI #cs.CL
- Gender Bias in Contextualized Word Embeddings
2019/04/05 by Jieyu Zhao, Tianlu Wang, Zhao, Jieyu +9 · 14 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- Formal Aspects of Language Modeling
2023/11/07 by Ryan Cotterell, Cotterell, Ryan, Anej Svete +7 · 2 voices · 4 citations
Computer Science · #Natural Language Processing Techniques #cs.CL
- Linear Adversarial Concept Erasure
2022/01/28 by Shauli Ravfogel, Michael Twiton, Ravfogel, Shauli +5 · 12 citations
Computer Science · #Adversarial Robustness in Machine Learning #Domain Adaptation and Few-Shot Learning #Machine Learning in Healthcare
- Controlled Text Generation with Natural Language Instructions
2023/04/27 by Wangchunshu Zhou, Yuchen Eleanor Jiang, Zhou, Wangchunshu +7 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Representation Surgery: Theory and Practice of Affine Steering
2024/02/15 by Shashwat Singh, Singh, Shashwat, Shauli Ravfogel +9 · 12 citations
Engineering · Computer Science · #Advancements in Semiconductor Devices and Circuit Design #Cellular Automata and Applications
- SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological\n Inflection
2020/06/20 by Ekaterina Vylomova, Vylomova, Ekaterina, Jennifer Duffield White +52 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- On the Challenges and Opportunities in Generative AI
2024/02/28 by Laura Manduchi, Manduchi, Laura, Kushagra Pandey +48 · 11 citations
Computer Science · #AI-based Problem Solving and Planning #Cognitive Computing and Networks #Evolutionary Algorithms and Applications
- BabyLM Turns 3: Call for papers for the 2025 BabyLM workshop
2025/02/15 by Lucas Charpentier, Leshem Choshen, Charpentier, Lucas +25 · 1 voice · 14 citations
#cs.CL
- The CoNLL--SIGMORPHON 2018 Shared Task: Universal Morphological Reinflection
2018/10/16 by Ryan Cotterell, Cotterell, Ryan, Christo Kirov +23 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation
2021/03/22 by Yuchen Eleanor Jiang, Jiang, Yuchen Eleanor, Tianyu Liu +17 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Fast Controlled Generation from Language Models with Adaptive Weighted Rejection Sampling
2025/04/07 by Benjamin Lipkin, Lipkin, Benjamin, Benjamin LeBrun +23 · 2 voices · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
- Controllable Context Sensitivity and the Knob Behind It
2024/11/11 by Julian Minder, Minder, Julian, Kevin Du +11 · 1 voice · 10 citations
Computer Science · #Explainable Artificial Intelligence (XAI) #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL
- Kernelized Concept Erasure
2022/01/28 by Shauli Ravfogel, Ravfogel, Shauli, Francisco Vargas +5 · 5 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- Examining the Inductive Bias of Neural Language Models with Artificial\n Languages
2021/06/02 by Jennifer C. White, White, Jennifer C., Ryan Cotterell +1 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Neural Networks and Applications #Topic Modeling
- Activation Scaling for Steering and Interpreting Language Models
2024/10/07 by Niklas Stoehr, Stoehr, Niklas, Kevin Du +9 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems
- On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
2024/06/20 by Franz Nowak, Anej Svete, Nowak, Franz +5 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Formal Languages and Automata Theory (cs.FL) #Topic Modeling
- A Geometric Notion of Causal Probing
2023/07/27 by Clément Guerner, Guerner, Clément, Tianyu Liu +7 · 4 citations
Arts and Humanities · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Philosophy and History of Science
- [Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus
2024/04/09 by Leshem Choshen, Ryan Cotterell, Choshen, Leshem +17 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Context versus Prior Knowledge in Language Models
2024/04/06 by Kevin Du, Vésteinn Snæbjarnarson, Du, Kevin +9 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Semantic Web and Ontologies #Topic Modeling
- Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discourse
2024/10/21 by Eleftheria Tsipidi, Tsipidi, Eleftheria, Franz Nowak +9 · 6 citations
Arts and Humanities · Computer Science · #Discourse Analysis in Language Studies #Natural Language Processing Techniques
- Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners?
2024/01/31 by Andreas Opedal, Opedal, Andreas, Alessandro Stolfo +13 · 5 citations
Social Sciences · Psychology · #Education and Critical Thinking Development #Emotional Intelligence and Performance
- What Do Language Models Learn in Context? The Structured Task Hypothesis
2024/06/06 by Jiaoda Li, Yifan Hou, Li, Jiaoda +5 · 4 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages
2024/06/06 by Nadav Borenstein, Anej Svete, Borenstein, Nadav +13 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- On the Diachronic Stability of Irregularity in Inflectional Morphology
2018/04/23 by Ryan Cotterell, Christo Kirov, Cotterell, Ryan +5 · 2 citations
Computer Science · Social Sciences · #Natural Language Processing Techniques #Language and cultural evolution #Topic Modeling
- From Language Models over Tokens to Language Models over Characters
2024/12/04 by Tim Vieira, Vieira, Tim, Ben LeBrun +13 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Training Neural Networks as Recognizers of Formal Languages
2024/11/11 by Alexandra Butoi, Ghazal Khalighinejad, Butoi, Alexandra +9 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Neural Networks and Applications
- Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing
2021/06/04 by Rowan Hall Maudslay, Maudslay, Rowan Hall, Ryan Cotterell +1 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Examining Gender Bias in Languages with Grammatical Gender
2019/09/05 by Pei Zhou, Weijia Shi, Zhou, Pei +11 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- A Bilingual Parallel Corpus with Discourse Annotations
2022/10/26 by Yuchen Eleanor Jiang, Tianyu Liu, Jiang, Yuchen Eleanor +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Generalized Measures of Anticipation and Responsivity in Online Language Processing
2024/09/16 by Mario Giulianelli, Giulianelli, Mario, Andreas Opedal +3 · 3 citations
Physics and Astronomy · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Theory (cs.IT) #Opinion Dynamics and Social Influence #Social Media and Politics
- On the Role of Context in Reading Time Prediction
2024/09/12 by Andreas Opedal, Eleanor Chodroff, Opedal, Andreas +5 · 3 citations
Computer Science · #Advanced Text Analysis Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
- Recurrent Neural Networks in Linguistic Theory: Revisiting Pinker and Prince (1988) and the Past Tense Debate
2018/07/12 by Christo Kirov, Ryan Cotterell, Kirov, Christo +1 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Quantifying the Semantic Core of Gender Systems
2019/10/29 by Adina Williams, Ryan Cotterell, Williams, Adina +7 · 1 citation
Computer Science · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender Studies in Language #Linguistic Variation and Morphology #Natural Language Processing Techniques
- On the Relationships Between the Grammatical Genders of Inanimate Nouns\n and Their Co-Occurring Adjectives and Verbs
2020/05/03 by Adina Williams, Ryan Cotterell, Williams, Adina +7 · 1 citation
Computer Science · Social Sciences · #Authorship Attribution and Profiling #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender Studies in Language #Natural Language Processing Techniques
- A Transformer with Stack Attention
2024/05/07 by Jiaoda Li, Jennifer C. White, Li, Jiaoda +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Sensor Technology and Measurement Systems
- Towards Explainability in Legal Outcome Prediction Models
2024/03/25 by Josef Valvoda, Ryan Cotterell, Valvoda, Josef +1 · 2 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Probing as Quantifying Inductive Bias
2021/10/15 by Alexander Immer, Immer, Alexander, Lucas Torroba Hennigen +5 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- Faster LLM Inference via Sequential Monte Carlo
2026/04/17 by Yahya Emara, Mauricio Barba da Costa, Chi-Chih Chang +4 · 1 voice
Computer Science · #cs.LG #cs.CL
- The Foundations of Tokenization: Statistical and Computational Concerns
2024/07/16 by Juan Luis Gastaldi, John Terilla, Gastaldi, Juan Luis +9 · 2 citations
Biochemistry, Genetics and Molecular Biology · #Genomics and Chromatin Dynamics
- Gumbel Counterfactual Generation From Language Models
2024/11/11 by Shauli Ravfogel, Ravfogel, Shauli, Anej Svete +5 · 1 voice · 2 citations
Computer Science · #Natural Language Processing Techniques
- Language Models over Canonical Byte-Pair Encodings
2025/06/09 by Tim Vieira, Vieira, Tim, Tianyu Liu +17 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Formal Languages and Automata Theory (cs.FL) #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- The Harmonic Structure of Information Contours
2025/06/04 by Eleftheria Tsipidi, Tsipidi, Eleftheria, Samuel Kiegeland +13 · 1 voice · 2 citations
Computer Science · Neuroscience · Psychology · Social Sciences · #Language and cultural evolution #Neurobiology of Language and Bilingualism #Phonetics and Phonology Research #cs.CL
- NARRATE: Versatile Language Architecture for Optimal Control in Robotics
2024/03/16 by Seif Ismail, Antonio Arbues, Ismail, Seif +7 · 2 citations
Computer Science · #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Real-Time Systems Scheduling #Robotic Path Planning Algorithms #Robotics (cs.RO)
- On the Proper Treatment of Tokenization in Psycholinguistics
2024/10/03 by Mario Giulianelli, Giulianelli, Mario, L. Malagutti +9 · 2 citations
Arts and Humanities · #Linguistic research and analysis
- All Roads Lead to Rome? Exploring the Invariance of Transformers' Representations
2023/05/23 by Yu‐Xin Ren, Ren, Yuxin, Qipeng Guo +11 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- The Causal Influence of Grammatical Gender on Distributional Semantics
2023/11/30 by Karolina Stańczak, Stańczak, Karolina, Kevin Du +7 · 1 citation
Arts and Humanities · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Gender Studies in Language #Language and cultural evolution #Language, Discourse, Communication Strategies
- On Efficiently Representing Regular Languages as RNNs
2024/02/24 by Anej Svete, Svete, Anej, Robin Shing Moon Chan +3 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Information Locality as an Inductive Bias for Neural Language Models
2025/06/05 by Taiga Someya, Anej Svete, Someya, Taiga +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Algorithms #Natural Language Processing Techniques #Topic Modeling
- Towards Developmentally Plausible Rewards: Communicative Success as a Learning Signal for Interactive Language Models
2025/05/09 by Lennart Stöpler, Rufat Asadli, Stöpler, Lennart +7 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Speech and dialogue systems #Topic Modeling
- Taxonomy-Aware Evaluation of Vision-Language Models
2025/04/07 by Vésteinn Snæbjarnarson, Kevin Du, Snæbjarnarson, Vésteinn +11 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Surprisal Theory is Tautological (without Rational Grounding)
2026/07/23 by Ryan Cotterell
#cs.CL
- A Compositional Theory of Causally Masked Transformers
2026/07/29 by Franz Nowak, Ryan Cotterell, Reda Boumasmoud
Computer Science · #cs.FL #cs.LG