2023/02/05 by Jafar Abbaszadeh Chekan, Chekan, Jafar Abbaszadeh, Cédric Langbort +1
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #FOS: Electrical engineering #Fault Detection and Control Systems #Machine Learning and Algorithms #Systems and Control (eess.SY) #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.2302.02270
openalex publication_date 2023/02/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Externally Forced Switched (EFS) systems represent a subset of switched systems where switches occur deliberately to meet an external requirement. However, fast switching can lead to instability, even when all closed-loop modes are stable. In this study, our focus is on an EFS scenario with unknown system dynamics, where the next mode to switch to is revealed by an external entity in real-time as the switch occurs. The challenge is to track the revealed sequence while (1) minimizing accumulated cost in a regretful sense and (2) ensuring that the norm of the system's state does not grow excessively-a property we refer to as 'the safety of switching.' Achieving the latter involves requiring the closed-loop system to remain in each revealed mode for some minimum dwell time, which must be learned online. We propose an algorithm based on the principles of Optimism in the Face of Uncertainty. This algorithm jointly establishes confidence sets for unknown parameters, devises a feedback policy, and estimates a minimum dwell time for each revealed mode from data. By precisely estimating dwell-time error, our strategy yields an expected regret of O(|M| √(ns)), where ns and |M| denote the total switches and mode count, respectively. We benchmark this approach against scenarios with known parameters.