A Primer in BERTology: What we know about how BERT works

2020/02/27 by Anna Rogers, Olga Kovaleva, Rogers, Anna +3 · 5 voices · 69 citations
#cs.CL

paper · pdf · doi:10.48550/arxiv.2002.12327

Abstract

Transformer-based models have pushed state of the art in many areas of NLP, but our understanding of what is behind their success is still limited. This paper is the first survey of over 150 studies of the popular BERT model. We review the current state of knowledge about how BERT works, what kind of information it learns and how it is represented, common modifications to its training objectives and architecture, the overparameterization issue and approaches to compression. We then outline directions for future research.

Cited by

• surprisal is Not a Theory
• Symbolic Augmentation Closes a Canonical-Equivalence Blind Spot in Neural Fact-Checkers
• Semantic Field Theory: Historical Origin, Higher-Order Interaction, and Stabilized Semantic Inference
• Parallel by design? Meaning and grammar in single-stream and dual-stream neural network architectures
• Remapping and navigation of an embedding space via error minimization: a fundamental organizational principle of cognition in natural and artificial systems
• When Models Manipulate Manifolds: The Geometry of a Counting Task
• The Dead Salmons of AI Interpretability
• Research Community Perspectives on "Intelligence" and Large Language Models
• LLMs as a synthesis between symbolic and distributed approaches to language
• Beyond Context: Large Language Models Failure to Grasp Users Intent
• Small Language Models for Efficient Agentic Tool Calling: Outperforming Large Models with Targeted Fine-tuning
• Characterizing Mamba's Selective Memory using Auto-Encoders
• Beyond surface form: A pipeline for semantic analysis in Alzheimer's Disease detection from spontaneous speech
• Scaling Bidirectional Spans and Span Violations in Attention Mechanism
• Let the Model Learn to Feel: Mode-Guided Tonality Injection for Symbolic Music Emotion Recognition
• HOLE: Homological Observation of Latent Embeddings for Neural Network Interpretability
• Attention as Binding: A Vector-Symbolic Perspective on Transformer Reasoning
• Mechanistic Interpretability of GPT-2: Lexical and Contextual Layers in Sentiment Analysis
• What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models
• Layer Probing Improves Kinase Functional Prediction with Protein Language Models
• Standard Occupation Classifier -- A Natural Language Processing Approach
• Generation, Evaluation, and Explanation of Novelists' Styles with Single-Token Prompts
• A Hybrid Classical-Quantum Fine Tuned BERT for Text Classification
• N-GLARE: An Non-Generative Latent Representation-Efficient LLM Safety Evaluator
• SymLoc: Symbolic Localization of Hallucination across HaluEval and TruthfulQA
• SPEAR-MM: Selective Parameter Evaluation and Restoration via Model Merging for Efficient Financial LLM Adaptation
• Catching Contamination Before Generation: Spectral Kill Switches for Agents
• Quantitative Bounds for Length Generalization in Transformers
• Enhancing Sentiment Classification with Machine Learning and Combinatorial Fusion
• Decomposition-Enhanced Training for Post-Hoc Attributions In Language Models
• Relation Geometry in Semantic Space of Language Models
• Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks
• Forging GEMs: Advancing Greek NLP through Quality-Based Corpus Curation
• Training-Free Spectral Fingerprints of Voice Processing in Transformers
• That's Deprecated! Understanding, Detecting, and Steering Knowledge Conflicts in Language Models for Code Generation
• Attention Is All You Need for KV Cache in Diffusion LLMs
• CAST: Compositional Analysis via Spectral Tracking for Understanding Transformer Layer Functions
• Ethic-BERT: An Enhanced Deep Learning Model for Ethical and Non-Ethical Content Classification
• Fairness Metric Design Exploration in Multi-Domain Moral Sentiment Classification using Transformer-Based Models
• Isotropy and Geometry of Pretrained Protein LMs
• Steering Embedding Models with Geometric Rotation: Mapping Semantic Relationships Across Languages and Models
• Entropy Meets Importance: A Unified Head Importance-Entropy Score for Stable and Efficient Transformer Pruning
• Exploring Cross-Lingual Knowledge Transfer via Transliteration-Based MLM Fine-Tuning for Critically Low-resource Chakma Language
• Search-R3: Unifying Reasoning and Embedding in Large Language Models
• Mechanistic Interpretability of Socio-Political Frames in Language Models
• Allocation of Parameters in Transformers
• Investigating Multi-layer Representations for Dense Passage Retrieval
• A short survey on almost orthogonal vectors in a few specific large dimensions
• Uncovering Graph Reasoning in Decoder-only Transformers with Circuit Tracing
• MUGEN: A Unified Framework for Efficient Motion Understanding and Generation
• A Novel Differential Feature Learning for Effective Hallucination Detection and Classification
• Steering Language Models in Multi-Token Generation: A Case Study on Tense and Aspect
• Documents Are People and Words Are Items: A Psychometric Approach to Textual Data with Contextual Embeddings
• Mask-GCG: Are All Tokens in Adversarial Suffixes Necessary for Jailbreak Attacks?
• Comparative Analysis of Transformer Models in Disaster Tweet Classification for Public Safety
• Learning Mechanism Underlying NLP Pre-Training and Fine-Tuning
• Towards Fundamental Language Models: Does Linguistic Competence Scale with Model Size?
• MindGuard: Intrinsic Decision Inspection for Securing LLM Agents Against Metadata Poisoning
• Transplant Then Regenerate: A New Paradigm for Text Data Augmentation
• Semantic Anchoring in Agentic Memory: Leveraging Linguistic Structures for Persistent Conversational Context
• Cognitive Decision Routing in Large Language Models: When to Think Fast, When to Think Slow
• Towards Reliable Generative AI-Driven Scaffolding: Reducing Hallucinations and Enhancing Quality in Self-Regulated Learning Support
• Streamlining Admission with LOR Insights: AI-Based Leadership Assessment in Online Master's Program
• I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations
• When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Models
• Length Representations in Large Language Models
• Large language model [wikipedia]
• Foundation model [wikipedia]
• BERT (language model) [wikipedia]

Discussions

• A Primer in BERTology: What We Know About How Bert Works [hn, 81 points, 16 comments]
• A Primer in BERTology: What we know about how BERT works [hn, 2 points, 0 comments]
• the "lesioning" is sometimes used in "BERTology" as well, where BeRt ology is the stdy of BERT models (which were a popular ealry pre chatGPT LLM used widely) see 6.3 for studies that kind of do lessi [bsky, 1 points, 1 comments]
• section 3.1 of arxiv.org/abs/2002.12327 mentions a number of other studies probing for linguistic structure learned by what's now a pretty simple model, let alone anything more recent/capable [bsky, 0 points, 0 comments]
• may I have a counter-argument: 1. Per your work, language models benefit from the human knowledge, but they don't fully rely on it: arxiv.org/abs/2002.12327 (my fav NLP paper) which agrees with the bi [bsky, 0 points, 2 comments]

Related

• What the [MASK]? Making Sense of Language-Specific BERT Models
• Lessons Learned from Applying off-the-shelf BERT: There is no Silver Bullet
• BERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT
• Emergent Properties of Finetuned Language Representation Models
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding