Information Theory as the Basis for Thermostatics and Thermodynamics

1961/03/01 by Myron Tribus · 13 citations
Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #Statistical Mechanics and Entropy

paper · doi:10.1115/1.3640461

Abstract

Information theory described in Part 1 provides a meaning for the concept of entropy independent of the field of thermodynamics. Using this meaning (uncertainty) it is possible to derive all of statistical and classical thermodynamics in a direct and simple way. Many of the concepts and definitions of classical thermodynamics are given a new interpretation. Using information theory as a basis for a statistical description of an open system, in Part 2, the laws and theorems of thermodynamics are seen to follow in a simple way. The coupling of irreversible flows (Onsager’s relation) is seen as a natural connection between thermostatics and thermodynamics if the functions introduced by Massieu are used instead of those introduced by Gibbs.

Cited by

• Balancing New Against Old Information: The Role of Surprise in Learning
• Minimisation of a Free-Energy-Like Potential for Non-Equilibrium Systems at Steady State
• Consistency of the Shannon entropy in quantum experiments
• Combinatorial Information Theory: I. Philosophical Basis of Cross-Entropy and Entropy
• On Markov blankets and hierarchical self-organisation. [europepmc]
• Information Theory and Cognition: A Review. [europepmc]
• Entropy, Carnot Cycle, and Information Theory. [europepmc]
• Maximum Entropy Analysis of Flow Networks: Theoretical Foundation and Applications. [europepmc]
• Dimensionless Groups by Entropic Similarity: I - Diffusion, Chemical Reaction and Dispersion Processes. [europepmc]
• Dimensionless Groups by Entropic Similarity: II-Wave Phenomena and Information-Theoretic Flow Regimes. [europepmc]
• A Thermodynamic Study on Information Power in Communication Systems. [europepmc]
• Entropy, Carnot Cycle and Information Theory, Part 2. [europepmc]
• Biological hirerachies emerged from natural characteristics of a number theory [europepmc]

Related

• What entropy really is : the contribution of information theory
• Thermodynamics of Information
• Information Mechanics
• Entropy: Mystery and Controversy. Plethora of Informational-Entropies and Unconventional Statistics
• Entropy, Divergence, and Majorization in Classical and Quantum Thermodynamics