Performance Evaluation and Comparison of a New Regression Algorithm

2023/06/15 by Sabina Gooljar, Gooljar, Sabina, Kris Manohar +3
Computer Science · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.2306.09105

openalex publication_date 2023/06/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In recent years, Machine Learning algorithms, in particular supervised learning techniques, have been shown to be very effective in solving regression problems. We compare the performance of a newly proposed regression algorithm against four conventional machine learning algorithms namely, Decision Trees, Random Forest, k-Nearest Neighbours and XG Boost. The proposed algorithm was presented in detail in a previous paper but detailed comparisons were not included. We do an in-depth comparison, using the Mean Absolute Error (MAE) as the performance metric, on a diverse set of datasets to illustrate the great potential and robustness of the proposed approach. The reader is free to replicate our results since we have provided the source code in a GitHub repository while the datasets are publicly available.

Related

• Experimental Study on 164 Algorithms Available in Software Tools for Solving Standard Non-Linear Regression Problems
• A Survey Of Regression Algorithms And Connections With Deep Learning
• Performance and Interpretability Comparisons of Supervised Machine Learning Algorithms: An Empirical Study
• Learning concise representations for regression by evolving networks of trees
• Analysis of Regression Tree Fitting Algorithms in Learning to Rank