Estimation of the transition density of a Markov chain

2012/10/18 by Mathieu Sart, Sart, Mathieu · 1 citation
Computer Science · Mathematics · #62G05 #62M05 #Bayesian Methods and Mixture Models #FOS: Mathematics #Markov Chains and Monte Carlo Methods #Statistical Methods and Inference #Statistics Theory (math.ST)

paper · doi:10.48550/arxiv.1210.5165

openalex publication_date 2012/10/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We present two data-driven procedures to estimate the transition density of an homogeneous Markov chain. The first yields to a piecewise constant estimator on a suitable random partition. By using an Hellinger-type loss, we establish non-asymptotic risk bounds for our estimator when the square root of the transition density belongs to possibly inhomogeneous Besov spaces with possibly small regularity index. Some simulations are also provided. The second procedure is of theoretical interest and leads to a general model selection theorem from which we derive rates of convergence over a very wide range of possibly inhomogeneous and anisotropic Besov spaces. We also investigate the rates that can be achieved under structural assumptions on the transition density.

Cited by

• Central Limit Theorems for Transition Probabilities of Controlled Markov Chains

Related

• Kernel estimation of the transition density in bifurcating Markov chains
• Adaptive Estimation of the Transition Density of Controlled Markov Chains
• Least squares estimation of the transition density in bifurcating Markov models
• A recursive nonparametric estimator for the transition kernel of a piecewise-deterministic Markov process
• Estimating the transition matrix of a Markov chain observed at random times