vix.ing · top · new · best · stats · spec

DarwinML: A Graph-based Evolutionary Algorithm for Automated Machine Learning

2018/11/20 by Fei Qi, Zhaohui Xia, Qi, Fei +15
Computer Science · #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Metaheuristic Optimization Algorithms Research #Neural and Evolutionary Computing (cs.NE)

paper · pdf · doi:10.48550/arxiv.1901.08013

openalex publication_date 2018/11/20 · openalex created_date 2019/02/21 · openalex updated_date 2026/07/28

Abstract

As an emerging field, Automated Machine Learning (AutoML) aims to reduce or eliminate manual operations that require expertise in machine learning. In this paper, a graph-based architecture is employed to represent flexible combinations of ML models, which provides a large searching space compared to tree-based and stacking-based architectures. Based on this, an evolutionary algorithm is proposed to search for the best architecture, where the mutation and heredity operators are the key for architecture evolution. With Bayesian hyper-parameter optimization, the proposed approach can automate the workflow of machine learning. On the PMLB dataset, the proposed approach shows the state-of-the-art performance compared with TPOT, Autostacker, and auto-sklearn. Some of the optimized models are with complex structures which are difficult to obtain in manual design.

Citations

Related