2012/03/03 by Güner D. Çelik, Celik, Güner D., Long Bao Le +3
Business, Management and Accounting · Computer Science · Engineering · #Advanced Queuing Theory Analysis #Advanced Wireless Network Optimization #Age of Information Optimization #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Optimization and Control (math.OC)
paper · pdf · doi:10.48550/arxiv.1203.0696
openalex publication_date 2012/03/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
We consider a dynamic server allocation problem over parallel queues with\nrandomly varying connectivity and server switchover delay between the queues.\nAt each time slot the server decides either to stay with the current queue or\nswitch to another queue based on the current connectivity and the queue length\ninformation. Switchover delay occurs in many telecommunications applications\nand is a new modeling component of this problem that has not been previously\naddressed. We show that the simultaneous presence of randomly varying\nconnectivity and switchover delay changes the system stability region and the\nstructure of optimal policies. In the first part of the paper, we consider a\nsystem of two parallel queues, and develop a novel approach to explicitly\ncharacterize the stability region of the system using state-action frequencies\nwhich are stationary solutions to a Markov Decision Process (MDP) formulation.\nWe then develop a frame-based dynamic control (FBDC) policy, based on the\nstate-action frequencies, and show that it is throughput-optimal asymptotically\nin the frame length. The FBDC policy is applicable to a broad class of network\ncontrol systems and provides a new framework for developing throughput-optimal\nnetwork control policies using state-action frequencies. Furthermore, we\ndevelop simple Myopic policies that provably achieve more than 90% of the\nstability region. In the second part of the paper, we extend our results to\nsystems with an arbitrary but finite number of queues.\n