2010/07/31 by D. Benedetto, D Benedetto, E. Caglioti +5
Computer Science · Materials Science · Mathematics · Physics and Astronomy · #Divergence (linguistics) #Entropy (arrow of time) #Entropy rate #Ergodic theory #Kullback–Leibler divergence #Limit (mathematics) #Quantum Mechanics and Non-Hermitian Physics #Quasicrystal Structures and Properties #Statistical Mechanics and Entropy #Substitution (logic) #cond-mat.stat-mech #cs.IT #math.IT #msc:68P30
paper · pdf · doi:10.1088/1742-5468/2010/09/p09010
13 pages , 2 figures
arxiv created 2010/08/22 · openalex publication_date 2010/09/17 · arxiv updated 2015/05/19 · openalex created_date 2016/06/24 · openalex updated_date 2026/08/05
The entropy of an ergodic source is the limit of properly rescaled one-block entropies of sources obtained applying successive non-sequential recursive pair substitutions (NSRPS). In this paper we prove that the cross-entropy and the Kullback–Leibler divergence can be obtained in a similar way.