To impute or not to impute: How machine learning modelers treat missing data

2025/03/20 by Chen, Wanyi, Cummings, Mary
#FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG)

paper · doi:10.48550/arxiv.2503.16644

Abstract

Missing data is prevalent in tabular machine learning (ML) models, and different missing data treatment methods can significantly affect ML model training results. However, little is known about how ML researchers and engineers choose missing data treatment methods and what factors affect their choices. To this end, we conducted a survey of 70 ML researchers and engineers. Our results revealed that most participants were not making informed decisions regarding missing data treatment, which could significantly affect the validity of the ML models trained by these researchers. We advocate for better education on missing data, more standardized missing data reporting, and better missing data analysis tools.

Related

• Impact of Missing Values in Machine Learning: A Comprehensive Analysis
• Does imputation matter? Benchmark for predictive models
• Not Another Imputation Method: A Transformer-based Model for Missing Values in Tabular Datasets
• Learning Accurate Models on Incomplete Data with Minimal Imputation
• The influence of missing data mechanisms and simple missing data handling techniques on fairness