vix.ing · top · new · best · stats

Entropy production and Kullback-Leibler divergence between stationary trajectories of discrete systems

2012/01/26 by Édgar Roldán, Juan M. R. Parrondo · 158 citations
Mathematics · Neuroscience · Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #Applied mathematics #Binary entropy function #Divergence (linguistics) #Entropy (arrow of time) #Entropy production #Entropy rate #Estimator #Kullback–Leibler divergence #Mathematical analysis #Mathematics #Maximum entropy probability distribution #Maximum entropy spectral estimation #Neural dynamics and brain function #Physics #Principle of maximum entropy #Series (stratigraphy) #Statistical physics #Statistics #Upper and lower bounds #cond-mat.stat-mech #stochastic dynamics and bifurcation

paper · pdf · doi:10.1103/physreve.85.031129

published in Physical Review E 85(3), 031129 (American Physical Society) · 14 pages, 7 figures

arxiv created 2012/01/26 · openalex publication_date 2012/03/21 · arxiv updated 2015/06/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05

Abstract

The irreversibility of a stationary time series can be quantified using the Kullback-Leibler divergence (KLD) between the probability of observing the series and the probability of observing the time-reversed series. Moreover, this KLD is a tool to estimate entropy production from stationary trajectories since it gives a lower bound to the entropy production of the physical process generating the series. In this paper we introduce analytical and numerical techniques to estimate the KLD between time series generated by several stochastic dynamics with a finite number of states. We examine the accuracy of our estimators for a specific example, a discrete flashing ratchet, and investigate how close the KLD is to the entropy production depending on the number of degrees of freedom of the system that are sampled in the trajectories.

Citations

Cited by

Related