vix.ing · top · new · best · stats · spec

Role of mutual information in entropy production under information exchanges

2013/07/31 by Takahiro Sagawa, Masahito Ueda
Mathematics · Neuroscience · Physics and Astronomy · Psychology · #Advanced Thermodynamics and Statistical Mechanics #Artificial intelligence #Cognitive psychology #Computer science #Economics #Entropy (arrow of time) #Entropy production #Fluctuation theorem #Information exchange #Information processing #Information theory #Mathematics #Microeconomics #Mutual information #Neural dynamics and brain function #Non-equilibrium thermodynamics #Physics #Production (economics) #Psychology #Second law of thermodynamics #Statistical physics #Statistics #Theoretical physics #Thermodynamics #cond-mat.stat-mech #stochastic dynamics and bifurcation

paper · pdf · doi:10.1088/1367-2630/15/12/125012

published as New J. Phys. 5, 125012 (2013) · Submitted to New Journal of Physics for the Focus Issue on "Nonequilibrium Fluctuation Relations: From Classical to Quantum"

arxiv created 2013/09/30 · openalex publication_date 2013/12/09 · arxiv updated 2015/06/16 · openalex created_date 2016/06/24 · openalex updated_date 2026/08/06

Abstract

We relate the information exchange between two stochastic systems to the nonequilibrium entropy production in the whole system. By deriving a general formula that decomposes the total entropy production into the thermodynamic and informational parts, we obtain nonequilibrium equalities such as the fluctuation theorem in the presence of information processing. Our results apply not only to situations under measurement and feedback control but also to those under multiple information exchanges between two systems, giving the fundamental energy cost for information processing and elucidating the thermodynamic and informational roles of a memory in information processing. We point out a dual relationship between measurement and feedback.

Citations