Expectation-based syntactic comprehension
2007/08/01 by Roger Levy, Roger Lévy · 109 citations
Neuroscience · Computer Science · #Neurobiology of Language and Bilingualism #Topic Modeling #Natural Language Processing Techniques
paper · doi:10.1016/j.cognition.2007.05.006
Citations
Cited by
- What’s Surprising About Surprisal
- A parallel architecture perspective on pre-activation and prediction in language processing
- Shared neural resources of rhythm and syntax: An ALE meta-analysis
- An Agent‐First Preference in a Patient‐First Language During Sentence Comprehension
- Prediction in SVO and SOV languages: processing and typological considerations
- Filtered Corpus Training (FiCT) Shows that Language Models Can Generalize from Indirect Evidence
- surprisal is Not a Theory
- The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices
- Contextual Semantic Relevance Tracks fMRI BOLD Responses During Naturalistic Speech Comprehension
- Encoding EEG Signals to Examine Human-Like Next-Word Prediction Behaviour in Language Models
- Not-So-Strange Love: Language Models and Generative Linguistic Theories are More Compatible than They Appear
- An Existence Proof for Neural Language Models That Can Explain Garden-Path Effects via Surprisal
- Across the Levels of Analysis: Explaining Predictive Processing in Humans Requires More Than Machine-Estimated Probabilities
- Linguists should learn to love speech-based deep learning models
- You can’t fight in here! This is BBS!
- Predicting Syntax: Processing Dative Constructions in American and Australian Varieties of English
- Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models
- A language network in the individualized functional connectomes of over 1,000 human brains doing arbitrary tasks
- Shades of Zero: Distinguishing Impossibility from Inconceivability
- Language Models Grow Less Humanlike beyond Phase Transition
- How linguistics learned to stop worrying and love the language models
- Deconstructing sentence disambiguation by joint latent modeling of reading paradigms: LLM surprisal is not enough
- RNNs as psycholinguistic subjects: Syntactic state and grammatical\n dependency
- Does referent predictability affect the choice of referential form? A\n computational approach using masked coreference resolution
- The neural architecture of language: Integrative modeling converges on predictive processing
- Representational Curvature Modulates Behavioral Uncertainty in Large Language Models
- Constructions and Compositionality
- Lexical Surprisal Shapes the Time Course of Syntactic Structure Building
- A scaling law of contextual persistence in human language
- On the Opportunities and Risks of Foundation Models
- What Do Prosody and Text Convey? Characterizing How Meaningful Information is Distributed Across Multiple Channels
- Large language models are not about natural language
- Turn-taking, timing, and planning in early language acquisition
- Memory retrieval and prediction interact in sentence comprehension: An experimental evaluation of a cue-based retrieval model
- More than words: Effects of grammaticality and lexical surprisal in self-paced reading
- Visuospatial working memory load reduces semantic prediction in the visual world
- Surprisal reveals diversity gaps in image captioning and different scorers change the story
- A Computational Approach to Analyzing Disrupted Language in Schizophrenia: Integrating Surprisal and Coherence Measures
- Cross-linguistic psycholinguistics and its critical role in theory development: early beginnings and recent advances
- Predicting syntactic choice in Mandarin Chinese: a corpus-based analysis ofbasentences and SVO sentences
- Exploration and exploitation of Victorian science in Darwin’s reading notebooks
- Child heritage speakers’ reading skills in the majority language and exposure to the heritage language support morphosyntactic prediction in speech
- Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle
- Context ameliorates but does not eliminate garden-pathing: Novel insights from latent-process modeling
- Shades of zero: Distinguishing impossibility from inconceivability
- Exploring the dynamics of Shannon’s information and iconicity in language processing and lexeme evolution
- CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain\n Natural Language Interfaces to Databases
- Time resolves syntactic-semantic conflict in temporary semantic illusions: Evidence from role reversal sentences
- PACR: Progressively Ascending Confidence Reward for LLM Reasoning
- The statistical significance filter leads to overoptimistic expectations of replicability
- How do linguistic illusions arise? Rational inference and good-enough processing as competing latent processes within individuals
- Explaining the Sentence Superiority Effect and N400s Elicited by Words and Short Sentences with OB1-Reader
- Local word statistics affect reading times independently of surprisal
- Grammaticality, Acceptability, and Probability: A Probabilistic View of Linguistic Knowledge
- A systematic evaluation of Dutch large language models’ surprisal estimates in sentence, paragraph and book reading
- Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language
- Competing Biases in Real-Time Sentence Processing
- From Input Perception to Predictive Insight: Modeling Model Blind Spots Before They Become Errors
- Are Language Models Models?
- An eye-tracking-with-EEG coregistration corpus of narrative sentences
- A Bayesian dawn in linguistics: Trends, benefits and good practices
- Modeling Bottom-up Information Quality during Language Processing
- Neural Language Models as Psycholinguistic Subjects: Representations of\n Syntactic State
- Uniform Information Density and Syntactic Reduction: Revisiting that-Mentioning in English Complement Clauses
- Semantic projection: recovering human knowledge of multiple, distinct object features from word embeddings
- An experimental and computational study of an Estonian single-person word naming
- Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling
- On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behavior
- How do Humans and LLMs Process Confusing Code?
- Character-based Surprisal as a Model of Reading Difficulty in the\n Presence of Error
- Bayesian Surprise Predicts Human Event Segmentation in Story Listening
- How Well Does First-Token Entropy Approximate Word Entropy as a Psycholinguistic Predictor?
- SPICE: Semantic Propositional Image Caption Evaluation
- Syntactic knowledge in a foreign language: examining cross-language transfer effects in L2 noun phrase comprehension
- Readers Are Parallel Processors
- Expectation-based Minimalist Grammars
- The cerebellar components of the human language network
- Dense Contexts Are Hard Contexts: Lexical Density Limits Effective Context in LLMs
- What Syntactic Structures block Dependencies in RNN Language Models?
- Modeling Fair Play in Detective Stories with Language Models
- Do People Prefer "Natural" code?
- Quasiregularity and Its Discontents: The Legacy of the Past Tense Debate
- A Biologically Plausible Parser
- Semantic and Phonological Prediction in Language Comprehension: Pretarget Attraction Toward Semantic and Phonological Competitors in a Mouse Tracking Task
- Incrementality and Prediction in Human Sentence Processing. [europepmc]
- Redundancy and reduction: speakers manage syntactic information density. [europepmc]
- Syntactic structure building in the anterior temporal lobe during natural story listening. [europepmc]
- Cortical representation of the constituent structure of sentences. [europepmc]
- Alignment as a consequence of expectation adaptation: syntactic priming is affected by the prime's prediction error given both prior and recent experience. [europepmc]
- How language production shapes language form and comprehension. [europepmc]
- The effect of word predictability on reading time is logarithmic. [europepmc]
- The P-chain: relating sentence production and its disorders to comprehension and acquisition. [europepmc]
- Reworking the language network. [europepmc]
- Zipf's word frequency law in natural language: a critical review and future directions. [europepmc]
- The role of domain-general cognitive control in language comprehension. [europepmc]
- Effects of prediction and contextual support on lexical processing: prediction takes precedence. [europepmc]
- Robust speech perception: recognize the familiar, generalize to the similar, and adapt to the novel. [europepmc]
- Syntactic processing is distributed across the language system. [europepmc]
- Language and thought are not the same thing: evidence from neuroimaging and neurological patients. [europepmc]
- What do we mean by prediction in language comprehension? [europepmc]
- Alpha and theta band dynamics related to sentential constraint and word expectancy. [europepmc]
- Statistical learning and probabilistic prediction in music cognition: mechanisms of stylistic enculturation. [europepmc]
- Hierarchical structure guides rapid linguistic predictions during naturalistic listening. [europepmc]
- Toward a Neurobiologically Plausible Model of Language-Related, Negative Event-Related Potentials. [europepmc]
- Two Distinct Neural Timescales for Predictive Speech Processing. [europepmc]
- fMRI reveals language-specific predictive coding during naturalistic sentence comprehension. [europepmc]
- The neural architecture of language: Integrative modeling converges on predictive processing. [europepmc]
- Parallel processing in speech perception with local and global representations of linguistic context. [europepmc]
- Semantic reconstruction of continuous language from non-invasive brain recordings. [europepmc]