A Survey of Freshness-Aware Wireless Networking with Reinforcement Learning

2025/12/24 by Alimu Alibotaiken, Alibotaiken, Alimu, Suyang Wang +5
Computer Science · #Age of Information Optimization #FOS: Computer and information sciences #FOS: Electrical engineering #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Opportunistic and Delay-Tolerant Networks #Systems and Control (eess.SY) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2512.21412

openalex publication_date 2025/12/24 · openalex created_date 2025/12/30 · openalex updated_date 2026/07/28

Abstract

The age of information (AoI) has become a central measure of data freshness in modern wireless systems, yet existing surveys either focus on classical AoI formulations or provide broad discussions of reinforcement learning (RL) in wireless networks without addressing freshness as a unified learning problem. Motivated by this gap, this survey examines RL specifically through the lens of AoI and generalized freshness optimization. We organize AoI and its variants into native, function-based, and application-oriented families, providing a clearer view of how freshness should be modeled in B5G and 6G systems. Building on this foundation, we introduce a policy-centric taxonomy that reflects the decisions most relevant to freshness, consisting of update-control RL, medium-access RL, risk-sensitive RL, and multi-agent RL. This structure provides a coherent framework for understanding how learning can support sampling, scheduling, trajectory planning, medium access, and distributed coordination. We further synthesize recent progress in RL-driven freshness control and highlight open challenges related to delayed decision processes, stochastic variability, and cross-layer design. The goal is to establish a unified foundation for learning-based freshness optimization in next-generation wireless networks.

Citations

• Safe Deep Reinforcement Learning for Resource Allocation with Peak Age of Information Violation Guarantees
• Age and Power Minimization via Meta-Deep Reinforcement Learning in UAV Networks
• Optimizing Age of Information without Knowing the Age of Information
• Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks
• Statistical Age of Information: A Risk-Aware Metric and Its Applications in Status Updates
• Age of Information Minimization using Multi-agent UAVs based on AI-Enhanced Mean Field Resource Allocation
• Scalable Cyclic Schedulers for Age of Information Optimization in Large-Scale Status Update Systems
• Age of Information in Gossip Networks: A Friendly Introduction and Literature Survey
• Age-Based Scheduling for Mobile Edge Computing: A Deep Reinforcement Learning Approach
• Ensemble DNN for Age-of-Information Minimization in UAV-assisted Networks
• Age Minimization in Massive IoT via UAV Swarm: A Multi-agent Reinforcement Learning Approach
• Deep Reinforcement Learning-Assisted Age-optimal Transmission Policy for HARQ-aided NOMA Networks
• Age of Information in Deep Learning-Driven Task-Oriented Communications
• Hierarchical Deep Reinforcement Learning for Age-of-Information Minimization in IRS-aided and Wireless-powered Wireless Networks
• Average Age of Information Penalty of Short-Packet Communications with Packet Management
• How Does Data Freshness Affect Real-time Supervised Learning?
• A Survey for Solving Mixed Integer Programming via Machine Learning
• Improving AoI via Learning-based Distributed MAC in Wireless Networks
• On-Demand AoI Minimization in Resource-Constrained Cache-Enabled IoT Networks with Energy Harvesting Sensors
• Age-of-information minimization via opportunistic sampling by an energy harvesting source
• A Deep Reinforcement Learning Approach for Improving Age of Information in Mission-Critical IoT
• Pull or Wait: How to Optimize Query Age of Information
• AoI-Aware Resource Allocation for Platoon-Based C-V2X Networks via Multi-Agent Multi-Task Reinforcement Learning
• Distributed Reinforcement Learning for Age of Information Minimization in Real-Time IoT Systems
• The Age of Correlated Features in Supervised Learning based Forecasting
• Age Debt: A General Framework For Minimizing Age of Information
• Analyzing Age of Information in Multiaccess Networks by Fluid Limits
• Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled\n Wireless Networks: A Tutorial
• Reinforcement Learning with Random Delays
• Cooperative Internet of UAVs: Distributed Trajectory Design by Multi-agent Deep Reinforcement Learning
• Analysis of Slotted ALOHA with an Age Threshold
• Age of Information: An Introduction and Survey
• Optimizing Information Freshness via Multiuser Scheduling with Adaptive NOMA/OMA
• Neural Combinatorial Deep Reinforcement Learning for Age-optimal Joint\n Trajectory and Scheduling Design in UAV-assisted Networks
• AoI-optimal Joint Sampling and Updating for Wireless Powered\n Communication Systems
• Reinforcement Learning for Combinatorial Optimization: A Survey
• Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks
• Risk-Aware Optimization of Age of Information in the Internet of Things
• Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach
• Survey of Deep Reinforcement Learning for Motion Planning of Autonomous\n Vehicles
• Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms
• Real-Time Reinforcement Learning
• Age-upon-Decisions Minimizing Scheduling in Internet of Things: To be Random or to be Deterministic?
• Spectrum Sensing Based on Deep Learning Classification for Cognitive Radios
• A Reinforcement Learning Framework for Optimizing Age-of-Information in RF-powered Communication Systems
• Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
• The Age of Incorrect Information: A New Performance Metric for Status Updates
• Closed-Form Analysis of Non-Linear Age-of-Information in Status Updates with an Energy Harvesting Transmitter
• Self-Supervised Exploration via Disagreement
• Deep Reinforcement Learning for Minimizing Age-of-Information in\n UAV-assisted Networks
• Age Based Task Scheduling and Computation Offloading in Mobile-Edge Computing Systems
• Reinforcement Learning to Minimize Age of Information with an Energy Harvesting Sensor with HARQ and Sensing Cost
• Relative Age of Information: A New Metric for Status Update Systems
• On the Role of Age of Information in the Internet of Things
• Joint Information Freshness and Completion Time Optimization for\n Vehicular Networks
• Reinforcement Learning Based Scheduling Algorithm for Optimizing Age of Information in Ultra Reliable Low Latency Networks
• Machine Learning for Combinatorial Optimization: a Methodological Tour\n d'Horizon
• Machine learning for combinatorial optimization: A methodological tour d’horizon
• Joint Status Sampling and Updating for Minimizing Age of Information in the Internet of Things
• The Age of Information in Networks: Moments, Distributions, and Sampling
• A Reinforcement Learning Approach to Age of Information in Multi-User Networks
• Optimizing Information Freshness in Wireless Networks under General\n Interference Constraints
• Distributed Scheduling Algorithms for Optimizing Information Freshness\n in Wireless Networks
• Scheduling Policies for Minimizing Age of Information in Broadcast Wireless Networks
• Average Age of Information with Hybrid ARQ under a Resource Constraint
• Learning with Opponent-Learning Awareness
• Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems
• Proximal Policy Optimization Algorithms
• A Distributional Perspective on Reinforcement Learning
• Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
• Age and Value of Information: Non-linear Age Case
• The Age of Information: Real-Time Status Updating by Multiple Sources
• Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation
• Convolutional Radio Modulation Recognition Networks
• Deep Recurrent Q-Learning for Partially Observable MDPs
• On The Age Of Information In Status Update Systems With Packet\n Management
• Playing Atari with Deep Reinforcement Learning
• A Linearly Convergent Conditional Gradient Algorithm with Applications to Online and Stochastic Optimization

Related

• Efficient Learning-based Scheduling for Information Freshness in Wireless Networks
• Optimizing Information Freshness in Wireless Networks: A Stochastic\n Geometry Approach
• Optimizing Age of Information without Knowing the Age of Information
• Understanding the Fundamental Trade-Off Between Age of Information and Throughput in Unreliable Wireless Networks
• Locally Adaptive Scheduling Policy for Optimizing Information Freshness in Wireless Networks