vix.ing · top · new · best · stats · spec

Uncertainty Resolution in Misinformation Detection

2024/01/02 by Yury Orlovskiy, Orlovskiy, Yury, Camille Thibault +9
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Misinformation and Its Impacts #Spam and Phishing Detection #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2401.01197

openalex publication_date 2024/01/02 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Misinformation poses a variety of risks, such as undermining public trust and distorting factual discourse. Large Language Models (LLMs) like GPT-4 have been shown effective in mitigating misinformation, particularly in handling statements where enough context is provided. However, they struggle to assess ambiguous or context-deficient statements accurately. This work introduces a new method to resolve uncertainty in such statements. We propose a framework to categorize missing information and publish category labels for the LIAR-New dataset, which is adaptable to cross-domain content with missing information. We then leverage this framework to generate effective user queries for missing context. Compared to baselines, our method improves the rate at which generated questions are answerable by the user by 38 percentage points and classification performance by over 10 percentage points macro F1. Thus, this approach may provide a valuable component for future misinformation mitigation pipelines.

Related