e-SNLI: Natural Language Inference with Natural Language Explanations

2018/12/04 by Oana-Maria Camburu, Tim Rocktäschel, Camburu, Oana-Maria +5 · 36 citations
Computer Science · #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.1812.01193

openalex publication_date 2018/12/04 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In order for machine learning to garner widespread public adoption, models must be able to provide interpretable and robust explanations for their decisions, as well as learn from human-provided explanations at train time. In this work, we extend the Stanford Natural Language Inference dataset with an additional layer of human-annotated natural language explanations of the entailment relations. We further implement models that incorporate these explanations into their training process and output them at test time. We show how our corpus of explanations, which we call e-SNLI, can be used for various goals, such as obtaining full sentence justifications of a model's decisions, improving universal sentence representations and transferring to out-of-domain NLI datasets. Our dataset thus opens up a range of research directions for using natural language explanations, both for improving models and for asserting their trust.

Cited by

• The Effectiveness of Approximate Regularized Replay for Efficient Supervised Fine-Tuning of Large Language Models
• Reason2Decide: Rationale-Driven Multi-Task Learning
• Training LLMs with LogicReward for Faithful and Rigorous Reasoning
• Explaining the Reasoning of Large Language Models Using Attribution Graphs
• Cognitive Mirrors: Exploring the Diverse Functional Roles of Attention Heads in LLM Reasoning
• Can LLMs Faithfully Explain Themselves in Low-Resource Languages? A Case Study on Emotion Detection in Persian
• Learning from Sufficient Rationales: Analysing the Relationship Between Explanation Faithfulness and Token-level Regularisation Strategies
• T-FIX: Text-Based Explanations with Features Interpretable to eXperts
• Multi-Step Knowledge Interaction Analysis via Rank-2 Subspace Disentanglement
• Agree, Disagree, Explain: Decomposing Human Label Variation in NLI through the Lens of Explanations
• SentiMaithili: A Benchmark Dataset for Sentiment and Reason Generation for the Low-Resource Maithili Language
• Putting on the Thinking Hats: A Survey on Chain of Thought Fine-tuning from the Perspective of Human Reasoning Mechanism
• Everything is Plausible: Investigating the Impact of LLM Rationales on Human Notions of Plausibility
• VideoNorms: Benchmarking Cultural Awareness of Video Language Models
• Bridging Collaborative Filtering and Large Language Models with Dynamic Alignment, Multimodal Fusion and Evidence-grounded Explanations
• Self-Filtered Distillation with LLMs-generated Trust Indicators for Reliable Patent Classification
• o-MEGA: Optimized Methods for Explanation Generation and Analysis
• Towards Transparent AI: A Survey on Explainable Language Models
• Dual-Head Reasoning Distillation: Improving Classifier Accuracy with Train-Time-Only Reasoning
• PEPS: Quantum-Inspired Reinforcement Learning for Coherent Reasoning Traces in LLMs
• Analyzing Uncertainty of LLM-as-a-Judge: Interval Evaluations with Conformal Prediction
• Extractive Fact Decomposition for Interpretable Natural Language Inference in one Forward Pass
• Quantifying Uncertainty in Natural Language Explanations of Large Language Models for Question Answering
• Do LLMs Adhere to Label Definitions? Examining Their Receptivity to External Label Definitions
• GIER: Gap-Driven Self-Refinement for Large Language Models
• Measuring and Improving Consistency in Pretrained Language Models
• Better Language Model-Based Judging Reward Modeling through Scaling Comprehension Boundaries
• Evaluating and Characterizing Human Rationales
• Adversarial Attacks on VQA-NLE: Exposing and Alleviating Inconsistencies in Visual Question Answering Explanations
• Are Training Resources Insufficient? Predict First Then Explain!
• Can LLM-Generated Textual Explanations Enhance Model Classification Performance? An Empirical Study
• Beyond Technocratic XAI: The Who, What & How in Explanation Design
• Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Models
• Alleviating Attention Hacking in Discriminative Reward Modeling through Interaction Distillation
• ISO-Bench: Benchmarking Multimodal Causal Reasoning in Visual-Language Models through Procedural Plans
• Order Constraints in Optimal Transport

Related

• Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI Models
• Generating Token-Level Explanations for Natural Language Inference
• Does External Knowledge Help Explainable Natural Language Inference?\n Automatic Evaluation vs. Human Ratings
• Do Natural Language Explanations Represent Valid Logical Arguments? Verifying Entailment in Explainable NLI Gold Standards
• Reasoning with Natural Language Explanations