vix.ing · top · new · best · stats · spec

Robust Logistic Regression using Shift Parameters (Long Version)

2013/05/21 by Julie Tibshirani, Christopher D. Manning, Tibshirani, Julie +1
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Topic Modeling #cs.AI #cs.LG #stat.ML

paper · pdf · doi:10.48550/arxiv.1305.4987

openalex publication_date 2013/05/21 · arxiv created 2014/04/29 · arxiv updated 2014/04/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Annotation errors can significantly hurt classifier performance, yet datasets are only growing noisier with the increased use of Amazon Mechanical Turk and techniques like distant supervision that automatically generate labels. In this paper, we present a robust extension of logistic regression that incorporates the possibility of mislabelling directly into the objective. Our model can be trained through nearly the same means as logistic regression, and retains its efficiency on high-dimensional datasets. Through named entity recognition experiments, we demonstrate that our approach can provide a significant improvement over the standard model when annotation errors are present.

Citations

Related