Learning Neural Differential Algebraic Equations via Operator Splitting

2024/03/19 by James Koch, Madelyn Shapiro, Koch, James +7 · 2 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.2403.12938

openalex publication_date 2024/03/19 · openalex created_date 2024/03/21 · openalex updated_date 2026/08/01

Abstract

Differential algebraic equations (DAEs) describe the temporal evolution of systems that obey both differential and algebraic constraints. Of particular interest are systems that contain implicit relationships between their components, such as conservation laws. Here, we present an Operator Splitting (OS) numerical integration scheme for learning unknown components of DAEs from time-series data. In this work, we show that the proposed OS-based time-stepping scheme is suitable for relevant system-theoretic data-driven modeling tasks. Presented examples include (i) the inverse problem of tank-manifold dynamics and (ii) discrepancy modeling of a network of pumps, tanks, and pipes. Our experiments demonstrate the proposed method's robustness to noise and extrapolation ability to (i) learn the behaviors of the system components and their interaction physics and (ii) disambiguate between data trends and mechanistic relationships contained in the system.

Cited by

• jaxdae: A JAX-native Differentiable Solver for Differential-Algebraic Equations in Coupled Multi-physics
• CHyLL: Learning Continuous Neural Representations of Hybrid Systems

Related

• Semi-Explicit Neural DAEs: Learning Long-Horizon Dynamical Systems with Algebraic Constraints
• A Simultaneous Approach for Training Neural Differential-Algebraic Systems of Equations
• Neural ODEs with Irregular and Noisy Data
• Operator-learning-inspired Modeling of Neural Ordinary Differential Equations
• On Neural Differential Equations