2025/06/27 by Shengyuan Huang, Huang, Shengyuan, Xiaoguang Yang +5
Computer Science · Engineering · #90C39 #91A50 #Adaptive Dynamic Programming Control #Advanced Control Systems Optimization #FOS: Electrical engineering #FOS: Mathematics #Optimization and Control (math.OC) #Stability and Control of Uncertain Systems #Systems and Control (eess.SY) #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.2506.22073
openalex publication_date 2025/06/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Considering linear-quadratic discrete-time games with unknown input/output/state (i/o/s) dynamics and state, we provide necessary and sufficient conditions for the existence and uniqueness of feedback Nash equilibria (FNE) in the finite-horizon game, based entirely on offline input/output data. We prove that the finite-horizon unknown-dynamics game and its corresponding known-dynamics game have the same FNEs, and provide detailed relationships between their respective FNE matrices. To simplify the computation of FNEs, we provide an invertibility condition and a corresponding algorithm that computes one FNE by solving a finite number of linear equation systems using offline data. For the infinite-horizon unknown-dynamics game, limited offline data restricts players to computing optimal strategies only over a finite horizon. We prove that the finite-horizon strategy ``watching T steps into the future and moving one step now,'' which is commonly used in classical optimal control, exhibits convergence in both the FNE matrices and the total costs in the infinite-horizon unknown-dynamics game, and further provide an analysis of the convergence rate of the total cost. The corresponding algorithm for the infinite-horizon game is proposed and its efficacy is demonstrated through a non-scalar numerical example.