vix.ing · top · new · best · stats · spec

System identification using Bayesian neural networks with nonparametric noise models

2021/04/25 by Christos Merkatas, Simo Särkkä, Merkatas, Christos +1
Computer Science · Engineering · #Control Systems and Identification #FOS: Computer and information sciences #Fault Detection and Control Systems #Gaussian Processes and Bayesian Inference #Machine Learning (stat.ML) #Methodology (stat.ME) #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.2104.12119

openalex publication_date 2021/04/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along with its unknown noise processes. In particular, we propose a Bayesian nonparametric approach for system identification in discrete time nonlinear random dynamical systems assuming only the order of the Markov process is known. The proposed method replaces the assumption of Gaussian distributed error components with a highly flexible family of probability density functions based on Bayesian nonparametric priors. Additionally, the functional form of the system is estimated by leveraging Bayesian neural networks which also leads to flexible uncertainty quantification. Asymptotically on the number of hidden neurons, the proposed model converges to full nonparametric Bayesian regression model. A Gibbs sampler for posterior inference is proposed and its effectiveness is illustrated on simulated and real time series.

Related