Active Learning for Argument Strength Estimation

2021/09/23 by Kees, Nataliia, Fromm, Michael, Faerman, Evgeniy +1
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)

paper · doi:10.48550/arxiv.2109.11319

Abstract

High-quality arguments are an essential part of decision-making. Automatically predicting the quality of an argument is a complex task that recently got much attention in argument mining. However, the annotation effort for this task is exceptionally high. Therefore, we test uncertainty-based active learning (AL) methods on two popular argument-strength data sets to estimate whether sample-efficient learning can be enabled. Our extensive empirical evaluation shows that uncertainty-based acquisition functions can not surpass the accuracy reached with the random acquisition on these data sets.

Related

• Evidential uncertainty sampling for active learning
• Understanding Uncertainty-based Active Learning Under Model Mismatch
• On weighted uncertainty sampling in active learning
• Active Learning Methods for Efficient Data Utilization and Model Performance Enhancement
• ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation