2024/05/07 by Paola Soto, Miguel Camelo, Soto, Paola +17
Business, Management and Accounting · Computer Science · #Artificial intelligence #Business #Collaboration in agile enterprises #Computer science #Deep learning #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI) #Reinforcement learning #Scaling #Service (business) #Service-Oriented Architecture and Web Services #Software System Performance and Reliability
paper · pdf · doi:10.48550/arxiv.2405.04441
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2024/05/07 · openalex created_date 2024/05/11 · openalex updated_date 2026/07/28
Automating network processes without human intervention is crucial for the complex Sixth Generation (6G) environment. Thus, 6G networks must advance beyond basic automation, relying on Artificial Intelligence (AI) and Machine Learning (ML) for self-optimizing and autonomous operation. This requires zero-touch management and orchestration, the integration of Network Intelligence (NI) into the network architecture, and the efficient lifecycle management of intelligent functions. Despite its potential, integrating NI poses challenges in model development and application. To tackle those issues, this paper presents a novel methodology to manage the complete lifecycle of Reinforcement Learning (RL) applications in networking, thereby enhancing existing Machine Learning Operations (MLOps) frameworks to accommodate RL-specific tasks. We focus on scaling computing resources in service-based architectures, modeling the problem as a Markov Decision Process (MDP). Two RL algorithms, guided by distinct Reward Functions (RFns), are proposed to autonomously determine the number of service replicas in dynamic environments. Our proposed methodology is anchored on a dual approach: firstly, it evaluates the training performance of these algorithms under varying RFns, and secondly, it validates their performance after being trained to discern the practical applicability in real-world settings. We show that, despite significant progress, the development stage of RL techniques for networking applications, particularly in scaling scenarios, still leaves room for significant improvements. This study underscores the importance of ongoing research and development to enhance the practicality and resilience of RL techniques in real-world networking environments.