A Review of Winograd Schema Challenge Datasets and Approaches

2020/04/23 by Vid Kocijan, Kocijan, Vid, Thomas Lukasiewicz +7 · 3 citations
Computer Science · #AI-based Problem Solving and Planning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2004.13831

openalex publication_date 2020/04/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The Winograd Schema Challenge is both a commonsense reasoning and natural language understanding challenge, introduced as an alternative to the Turing test. A Winograd schema is a pair of sentences differing in one or two words with a highly ambiguous pronoun, resolved differently in the two sentences, that appears to require commonsense knowledge to be resolved correctly. The examples were designed to be easily solvable by humans but difficult for machines, in principle requiring a deep understanding of the content of the text and the situation it describes. This paper reviews existing Winograd Schema Challenge benchmark datasets and approaches that have been published since its introduction.

Citations

• A Simple Method for Commonsense Reasoning
• Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models
• The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence

Cited by

• C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations
• Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models
• Künstliche Intelligenz, quo vadis?

Related

• The Defeat of the Winograd Schema Challenge
• WinoGrande: An Adversarial Winograd Schema Challenge at Scale
• WinoWhy: A Deep Diagnosis of Essential Commonsense Knowledge for Answering Winograd Schema Challenge
• Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema
• Winograd Schemas and Machine Translation