Demonstration of Enhanced Monte Carlo Computation of the Fisher Information for Complex Problems

2014/05/07 by Xumeng Cao, Cao, Xumeng
Mathematics · #Computation (stat.CO) #FOS: Computer and information sciences #stat.CO

paper · pdf · doi:10.48550/arxiv.1405.1491

arxiv created 2014/05/07 · arxiv updated 2014/05/08

Abstract

The Fisher information matrix summarizes the amount of information in a set of data relative to the quantities of interest. There are many applications of the information matrix in statistical modeling, system identification and parameter estimation. This short paper reviews a feedback-based method and an independent perturbation approach for computing the information matrix for complex problems, where a closed form of the information matrix is not achievable. We show through numerical examples how these methods improve the accuracy of the estimate of the information matrix compared to the basic resampling-based approach. Some relevant theory is summarized.

Related

• Enhanced Monte Carlo Estimation of the Fisher Information Matrix with Independent Perturbations for Complex Problems
• How to estimate Fisher information matrices from simulations
• Method for Computation of the Fisher Information Matrix in the Expectation-Maximization Algorithm
• Estimating Fisher Information Matrix in Latent Variable Models based on the Score Function
• Computing an empirical Fisher information matrix estimate in latent variable models through stochastic approximation