2024/06/20 by Ioannis Mavromatis, Mavromatis, Ioannis, K. B. Katsaros +3 · 1 citation
Computer Science · #Big Data and Digital Economy #Cloud Computing and Resource Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
paper · pdf · doi:10.48550/arxiv.2406.14328
openalex publication_date 2024/06/20 · openalex created_date 2024/06/22 · openalex updated_date 2026/07/28
Machine learning (ML) has seen tremendous advancements, but its environmental footprint remains a concern. Acknowledging the growing environmental impact of ML this paper investigates Green ML, examining various model architectures and hyperparameters in both training and inference phases to identify energy-efficient practices. Our study leverages software-based power measurements for ease of replication across diverse configurations, models and datasets. In this paper, we examine multiple models and hardware configurations to identify correlations across the various measurements and metrics and key contributors to energy reduction. Our analysis offers practical guidelines for constructing sustainable ML operations, emphasising energy consumption and carbon footprint reductions while maintaining performance. As identified, short-lived profiling can quantify the long-term expected energy consumption. Moreover, model parameters can also be used to accurately estimate the expected total energy without the need for extensive experimentation.