Reference-Free Iterative Learning Model Predictive Control with Neural Certificates

2025/07/18 by Wataru Hashimoto, Hashimoto, Wataru, Kazumune Hashimoto +5 · 1 citation
Engineering · #Advanced Control Systems Optimization #Control Systems and Identification #FOS: Electrical engineering #Iterative Learning Control Systems #Systems and Control (eess.SY) #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2507.14025

openalex publication_date 2025/07/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In this paper, we propose a novel reference-free iterative learning model predictive control (MPC). In the proposed method, a certificate function based on the concept of Control Lyapunov Barrier Function (CLBF) is learned using data collected from past control executions and used to define the terminal set and cost in the MPC optimization problem at the current iteration. This scheme enables the progressive refinement of the MPC's terminal components over successive iterations. Unlike existing methods that rely on mixed-integer programming and suffer from numerical difficulties, the proposed approach formulates the MPC optimization problem as a standard nonlinear program, enabling more efficient online computation. The proposed method satisfies key MPC properties, including recursive feasibility and asymptotic stability. Additionally, we demonstrate that the performance cost is non-increasing with respect to the number of iterations, under certain assumptions. Numerical experiments including the simulation with PyBullet confirm that our control scheme iteratively enhances control performance and significantly improves online computational efficiency compared to the existing methods.

Citations

• Synthesis of Model Predictive Control and Reinforcement Learning: Survey and Classification
• AC4MPC: Actor-Critic Reinforcement Learning for Nonlinear Model Predictive Control
• Lyapunov-stable Neural Control for State and Output Feedback: A Novel Formulation
• Neural Lyapunov Control for Discrete-Time Systems
• Predictive Control with Learning-Based Terminal Costs Using Approximate Value Iteration
• Safe Control with Learned Certificates: A Survey of Neural Lyapunov, Barrier, and Contraction methods
• Learning Robust Output Control Barrier Functions from Safe Expert Demonstrations
• Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functions
• Lyapunov-stable neural-network control
• On the Optimality and Convergence Properties of the Iterative Learning Model Predictive Controller
• Distributed Learning Model Predictive Control for Linear Systems
• Neural Certificates for Safe Control Policies
• Neural Lyapunov Control
• Learning Control Barrier Functions from Expert Demonstrations
• Control Barrier Functions: Theory and Applications
• Learning How to Autonomously Race a Car: a Predictive Control Approach
• The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical Systems
• Learning Model Predictive Control for iterative tasks. A Data-Driven\n Control Framework

Cited by

• MM-LMPC: Multi-Modal Learning Model Predictive Control via Bandit-Based Mode Selection

Related

• Learning Model Predictive Control for Iterative Tasks: A Computationally Efficient Approach for Linear System
• Learning Model Predictive Control for iterative tasks. A Data-Driven\n Control Framework
• Safe and Efficient Model Predictive Control Using Neural Networks: An Interior Point Approach
• Constrained Deep Learning Based Nonlinear Model Predictive Control
• Neural Lyapunov Model Predictive Control: Learning Safe Global Controllers from Sub-optimal Examples