2023/05/18 by Lilian Aline Weber, Lilian Weber, Weber, Lilian Aline +11 · 1 voice · 3 citations
Computer Science · #Algorithm #Artificial intelligence #Artificial neural network #Bayes' theorem #Bayesian Modeling and Causal Inference #Bayesian probability #Computer science #Gaussian Processes and Bayesian Inference #Machine learning #Neural Networks and Applications #Theoretical computer science
paper · pdf · doi:10.48550/arxiv.2305.10937
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2023/05/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01
Hierarchical Bayesian models of perception and learning feature prominently in contemporary cognitive neuroscience where, for example, they inform computational concepts of mental disorders. This includes predictive coding and hierarchical Gaussian filtering (HGF), which differ in the nature of hierarchical representations. In this work, we present a new class of artificial neural networks that unifies computational principles of PC and HGFs. We extend the space of generative models underlying HGF to include a form of nonlinear hierarchical coupling between state values akin to predictive coding and artificial neural networks in general. We derive the update equations corresponding to this generalization of HGF and conceptualize them as connecting a network of (belief) nodes where parent nodes either predict the state of child nodes or their rate of change. This enables us to (1) create modular architectures with generic computational steps in each node of the network, and (2) disclose the hierarchical message passing implied by generalized HGF models and to compare this to comparable schemes under predictive coding. The practical advances of this work are twofold: on the one hand, our extension allows for a modular construction of ANNs of arbitrarily complex hierarchical structure under the general principles of HGF. On the other hand, by providing a highly flexible implementation of hierarchical Bayesian models available as open source software, it enables new types of empirical data analysis in computational psychiatry.