An elementary introduction to information geometry

2018/08/17 by Frank Nielsen · 1 voice · 8 citations
Computer Science · Mathematics · #cs.LG #cs.IT #stat.ML

paper · pdf · doi:10.3390/e22101100

arxiv published 2018/08/17 · arxiv updated 2020/09/06

Abstract

In this survey, we describe the fundamental differential-geometric structures of information manifolds, state the fundamental theorem of information geometry, and illustrate some use cases of these information manifolds in information sciences. The exposition is self-contained by concisely introducing the necessary concepts of differential geometry, but proofs are omitted for brevity.

Cited by

• Enforcing Latent Euclidean Geometry in Single-Cell VAEs for Manifold Interpolation
• Near-Optimal Clustering in Mixture of Markov Chains
• Foundations of Top-k Decoding For Language Models
• Rényi-Induced Information Geometry and Hartigan's Prior Family
• Fisher-Rao distances between finite-energy signals in Gaussian noise
• Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks?
• An Information-Geometric Framework for Bayesian Credit Risk Monitoring
• The Information Geometry of Softmax: Probing and Steering

Discussions

• An elementary introduction to information geometry [hn, 2 points, 0 comments]