Bayesian Neural Networks for Functional ANOVA model

2025/10/01 by Seokhun Park, Choeun Kim, Park, Seokhun +8
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.2510.00545

openalex publication_date 2025/10/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/03

Abstract

With the increasing demand for interpretability in machine learning, functional ANOVA decomposition has gained renewed attention as a principled tool for breaking down high-dimensional function into low-dimensional components that reveal the contributions of different variable groups. Recently, Tensor Product Neural Network (TPNN) has been developed and applied as basis functions in the functional ANOVA model, referred to as ANOVA-TPNN. A disadvantage of ANOVA-TPNN, however, is that the components to be estimated must be specified in advance, which makes it difficult to incorporate higher-order TPNNs into the functional ANOVA model due to computational and memory constraints. In this work, we propose Bayesian-TPNN, a Bayesian inference procedure for the functional ANOVA model with TPNN basis functions, enabling the detection of higher-order components with reduced computational cost compared to ANOVA-TPNN. We develop an efficient MCMC algorithm and demonstrate that Bayesian-TPNN performs well by analyzing multiple benchmark datasets. Theoretically, we prove that the posterior of Bayesian-TPNN is consistent.

Citations

• Tensor Product Neural Networks for Functional ANOVA Model
• META-ANOVA: Screening interactions for interpretable machine learning
• Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inference
• Label-Free Concept Bottleneck Models
• Neural Additive Models for Location Scale and Shape: A Framework for Interpretable Neural Regression Beyond the Mean
• Statistical Aspects of SHAP: Functional ANOVA for Model Interpretation
• Neural Basis Models for Interpretability
• Estimating a regression function in exponential families by model selection
• Generalized Bayesian Additive Regression Trees Models: Beyond Conditional Conjugacy
• Generalized Bayesian Additive Regression Trees Models: Beyond Conditional Conjugacy
• NODE-GAM: Neural Generalized Additive Model for Interpretable Deep Learning
• What Are Bayesian Neural Network Posteriors Really Like?
• Learning Transferable Visual Models From Natural Language Supervision
• Deep Deterministic Uncertainty: A Simple Baseline
• Concept Bottleneck Models
• Neural Additive Models: Interpretable Machine Learning with Neural Nets
• Bayesian Deep Learning and a Probabilistic Perspective of Generalization
• A Systematic Comparison of Bayesian Deep Learning Robustness in Diabetic Retinopathy Tasks
• Purifying Interaction Effects with the Functional ANOVA: An Efficient Algorithm for Recovering Identifiable Additive Models
• Verified Uncertainty Calibration
• MaskGAN: Towards Diverse and Interactive Facial Image Manipulation
• A Unified Approach to Interpreting Model Predictions
• Detecting Statistical Interactions from Neural Network Weights
• Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
• "Why Should I Trust You?": Explaining the Predictions of Any Classifier
• Collaborative Deep Learning for Recommender Systems
• bartMachine: Machine Learning with Bayesian Additive Regression Trees
• Strictly Proper Scoring Rules, Prediction, and Estimation
• A Practical Bayesian Framework for Backpropagation Networks

Related

• Tensor Product Neural Networks for Functional ANOVA Model
• Neural-ANOVA: Analytical Model Decomposition using Automatic Integration
• Bayesian Tensorized Neural Networks with Automatic Rank Selection
• An Efficient Approach to Regression Problems with Tensor Neural Networks
• The Bayesian Method of Tensor Networks