A Precis of Language Models are not Models of Language

2022/05/16 by Csaba Veres, Veres, Csaba
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2205.07634

openalex publication_date 2022/05/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Natural Language Processing is one of the leading application areas in the current resurgence of Artificial Intelligence, spearheaded by Artificial Neural Networks. We show that despite their many successes at performing linguistic tasks, Large Neural Language Models are ill-suited as comprehensive models of natural language. The wider implication is that, in spite of the often overbearing optimism about AI, modern neural models do not represent a revolution in our understanding of cognition.

Related

• Large Language Models are not Models of Natural Language: they are Corpus Models
• Large language models are not about natural language
• Human Language Understanding & Reasoning
• The Quo Vadis of the Relationship between Language and Large Language Models
• A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates