2024/12/12 by Teddy Lazebnik, Lazebnik, Teddy
Computer Science · #Algorithm #Artificial intelligence #Computer science #Data Stream Mining Techniques #Ensemble learning #Genetic algorithm #Machine Learning and Data Classification #Machine learning #Metaheuristic Optimization Algorithms Research
paper · pdf · doi:10.48550/arxiv.2412.09035
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2024/12/12 · openalex created_date 2024/12/14 · openalex updated_date 2026/07/28
Data-driven models, in general, and machine learning (ML) models, in particular, have gained popularity over recent years with an increased usage of such models across the scientific and engineering domains. When using ML models in realistic and dynamic environments, users need to often handle the challenge of concept drift (CD). In this study, we explore the application of genetic algorithms (GAs) to address the challenges posed by CD in such settings. We propose a novel two-level ensemble ML model, which combines a global ML model with a CD detector, operating as an aggregator for a population of ML pipeline models, each one with an adjusted CD detector by itself responsible for re-training its ML model. In addition, we show one can further improve the proposed model by utilizing off-the-shelf automatic ML methods. Through extensive synthetic dataset analysis, we show that the proposed model outperforms a single ML pipeline with a CD algorithm, particularly in scenarios with unknown CD characteristics. Overall, this study highlights the potential of ensemble ML and CD models obtained through a heuristic and adaptive optimization process such as the GA one to handle complex CD events.