2025/11/10 by Di Zhang, Zhang, Di
Computer Science · Mathematics · #42A85 #62F15 #65C60 #65T50 #E.4 #FOS: Computer and information sciences #FOS: Mathematics #G.1.2 #G.3 #Gaussian Processes and Bayesian Inference #Generative Adversarial Networks and Image Synthesis #I.2.6 #Information Theory (cs.IT) #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Numerical Analysis (math.NA) #Statistics Theory (math.ST)
paper · pdf · doi:10.48550/arxiv.2511.06978
openalex publication_date 2025/11/10 · openalex created_date 2025/11/12 · openalex updated_date 2026/07/28
Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov Chain Monte Carlo (MCMC) and Variational Inference (VI) face significant scalability and efficiency limitations. This paper introduces a novel, unifying framework for fast Bayesian updates by leveraging harmonic analysis. We demonstrate that representing the prior and likelihood in a suitable orthogonal basis transforms the Bayesian update rule into a spectral convolution. Specifically, the Fourier coefficients of the posterior are shown to be the normalized convolution of the prior and likelihood coefficients. To achieve computational feasibility, we introduce a spectral truncation scheme, which, for smooth functions, yields an exceptionally accurate finite-dimensional approximation and reduces the update to a circular convolution. This formulation allows us to exploit the Fast Fourier Transform (FFT), resulting in a deterministic algorithm with O(N log N) complexity -- a substantial improvement over the O(N2) cost of naive methods. We establish rigorous mathematical criteria for the applicability of our method, linking its efficiency to the smoothness and spectral decay of the involved distributions. The presented work offers a paradigm shift, connecting Bayesian computation to signal processing and opening avenues for real-time, sequential inference in a wide class of problems.