Not-So-Strange Love: Language Models and Generative Linguistic Theories are More Compatible than They Appear

2026/05/11 by R. Thomas McCoy · 1 voice
#cs.CL #cs.AI

paper · pdf

Abstract

Futrell and Mahowald (2025) frame the success of neural language models (LMs) as supporting gradient, usage-based linguistic theories. I argue that LMs can also instantiate theories based on formal structures - the types of theories seen in the generative tradition. This argument expands the space of theories that can be tested with LMs, potentially enabling reconciliations between usage-based and generative accounts.

Citations

• What enables human language? A biocultural framework
• Both Direct and Indirect Evidence Contribute to Dative Alternation Preferences in Language Models
• Deep Learning is Not So Mysterious or Different
• What’s Surprising About Surprisal
• LLMs as a synthesis between symbolic and distributed approaches to language
• The metaphors of artificial intelligence
• Reclaiming AI as a Theoretical Tool for Cognitive Science
• Human-like Linguistic Biases in Neural Speech Models: Phonetic Categorization and Phonotactic Constraints in Wav2Vec2.0
• Decomposing modal thought.
• AI models collapse when trained on recursively generated data
• Filtered Corpus Training (FiCT) Shows that Language Models Can Generalize from Indirect Evidence
• The Platonic Representation Hypothesis
• Bridging the Empirical-Theoretical Gap in Neural Network Formal Language Learning Using Minimum Description Length
• Power Hungry Processing: Watts Driving the Cost of AI Deployment?
• Over-reliance on English hinders cognitive science
• On Logical Inference over Brains, Behaviour, and Artificial Neural Networks
• Understanding deep learning (still) requires rethinking generalization
• Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex
• Expectation-based syntactic comprehension
• Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language
• The TRACE model of speech perception

Discussions

• 🤖🧠 New commentary 🧠🤖 What role should large language models (LLMs) play in linguistics? I reflect on this question in a commentary now on arXiv: arxiv.org/abs/2605.10061 To appear in BBS as a comm [bsky, 29 points, 0 comments]

Related

• On the Compatibility of Generative AI and Generative Linguistics
• How linguistics learned to stop worrying and love the language models
• A Precis of Language Models are not Models of Language
• Large Language Models are not Models of Natural Language: they are Corpus Models
• Linguists should learn to love speech-based deep learning models