Information Theory and Statistical Mechanics. II
1957/10/15 by E. T. Jaynes · 3,231 citations
Mathematics · Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #Density matrix #Differential equation #Mathematical physics #Mathematics #Physics #Quantum Mechanics and Applications #Quantum mechanics #Semiclassical physics #Statistical Mechanics and Entropy #Statistical mechanics #Statistical physics
paper · doi:10.1103/physrev.108.171
published in Physical Review 108(2), 171-190 (American Institute of Physics)
openalex publication_date 1957/10/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/06
Abstract
Treatment of the predictive aspect of statistical mechanics as a form of statistical inference is extended to the density-matrix formalism and applied to a discussion of the relation between irreversibility and information loss. A principle of "statistical complementarity" is pointed out, according to which the empirically verifiable probabilities of statistical mechanics necessarily correspond to incomplete predictions. A preliminary discussion is given of the second law of thermodynamics and of a certain class of irreversible processes, in an approximation equivalent to that of the semiclassical theory of radiation.It is shown that a density matrix does not in general contain all the information about a system that is relevant for predicting its behavior. In the case of a system perturbed by random fluctuating fields, the density matrix cannot satisfy any differential equation because \stackrel\ifmmode \else \.\fi\ensuremathρ(t) does not depend only on \ensuremathρ(t), but also on past conditions The rigorous theory involves stochastic equations in the type \ensuremathρ(t)=G(t, 0)\ensuremathρ(0), where the operator G is a functional of conditions during the entire interval (0\ensuremath→t). Therefore a general theory of irreversible processes cannot be based on differential rate equations corresponding to time-proportional transition probabilities. However, such equations often represent useful approximations.
Cited by
- Stochastic Control Liaisons: Richard Sinkhorn Meets Gaspard Monge on a Schrödinger Bridge
- Emergence of a Second Law of Thermodynamics in Isolated Quantum Systems
- Uncertainty Analysis in Software Reliability Modeling by Bayesian Analysis with Maximum-Entropy Principle
- Eigenstate thermalization hypothesis
- Quantum-enhanced measurements without entanglement
- Black Holes and Entropy
- Characterizing Quantum Theory in Terms of Information-Theoretic Constraints
- Nonequilibrium physics of brain dynamics
- A high-bias, low-variance introduction to Machine Learning for physicists
- Contemplative Superalignment
- Emergence of thermodynamic behavior within composite quantum systems
- Enhancing robustness in machine-learning-accelerated molecular dynamics: A multi-model nonparametric probabilistic approach
- Principles of maximum entropy and maximum caliber in statistical physics
- Resolute and Correlated Bayesians
- A Generalized Free Energy Perturbation Theory Accounting for End States with Differing Configuration Space Volume
- Comparison Between Bayesian and Maximum Entropy Analyses of Flow Networks†
- Irreversibility in the short memory approximation
- Soot aggregate sizing through multiangle elastic light scattering: Influence of model error
- Subjective probability and quantum certainty
- Cocaine diminishes functional network robustness and destabilizes the energy landscape of neuronal activity in the medial prefrontal cortex
- Review of dependence modeling in hydrology and water resources
- Classical and quantum mechanics of the damped harmonic oscillator
- New entropy-based method for variables selection and its application to the debris-flow hazard assessment
- Exciton entanglement in two coupled semiconductor microcrystallites
- Recenti sviluppi dei metodi ergodici nella meccanica statistica
- Statistical mechanics in the context of special relativity
- Alternative approach to maximum-entropy inference
- Arrows of time and chaotic properties of the cosmic background radiation
- Fundamental Work Cost of Quantum Processes
- Maximum entropy and Bayesian data analysis: Entropic prior distributions
- Entropic Dynamics, Time and Quantum Theory
- A Physical Axiomatic Approach to Schrodinger's Equation
- Nonextensive Thermostatistics and theHTheorem
- Tomographic reconstruction of quantum correlations in excited Bose-Einstein condensates
- The Generalized Boltzmann Distribution is the Only Distribution in Which the Gibbs-Shannon Entropy Equals the Thermodynamic Entropy
- Minimum entropy approach to word segmentation problems
- Using relative entropy to find optimal approximations: An application to simple fluids
- Finite size effects in canonical Fermi systems
- The p-sphere and the geometric substratum of power-law probability distributions
- The eigenstate thermalization hypothesis in constrained Hilbert spaces: A case study in non-Abelian anyon chains
- Quantum coding
- Variational principle underlying scale invariant social systems
- Uncertainty quantification through Monte Carlo method in a cloud computing setting
- Comparison of quantum and semiclassical radiation theories with application to the beam maser
- What is a complex system?
- Assessing the significance of fidelity as a figure of merit in quantum state reconstruction of discrete and continuous-variable systems
- Generalized Gibbs ensemble in integrable lattice models
- A General Pairwise Interaction Model Provides an Accurate Description of In Vivo Transcription Factor Binding Sites
- Mesoscopic transport beyond linear response
- Classical and quantum probability
- Generating statistical distributions without maximizing the entropy
- Black Hole Entropy: From Shannon to Bekenstein
- Thermal roots of correlation‐based complexity
- Invertible cellular automata: A review
- Non-extensive approach to quark matter
- Scale-invariance underlying the logistic equation and its social applications
- Maximum entropy production and the fluctuation theorem
- Prior Probabilities
- Nonlinear quantum cosmology
- Quantum phase transitions without thermodynamic limits
- Illusory Decoherence
- High-order maximum-entropy collocation methods
- Signal detection in nearly continuous spectra and symmetry breaking
- Thermodynamics of memory erasure via a spin reservoir
- Renormalization and Short Distance Singular Structure
- Inverse Ising inference with correlated samples
- From reversible quantum microdynamics to irreversible quantum transport
- Spacing distribution functions for the one-dimensional point-island model with irreversible attachment
- Gibbs entropy of network ensembles by cavity methods
- Nonextensive random-matrix theory based on Kaniadakis entropy
- Combining cosmological data sets: hyperparameters and Bayesian evidence
- Reducing Degeneracy in Maximum Entropy Models of Networks
- Kirchhoff’s loop law and the maximum entropy production principle
- Dynamic versus thermodynamic approach to non-canonical equilibrium
- Hydrodynamics in an external field
- A Survey on Quantum Channel Capacities
- A Tractable Method for Describing Complex Couplings between Neurons and Population Rate
- Maximum information entropy principle and the interpretation of probabilities in statistical mechanics − a short review
- Macroscopic Time Evolution and MaxEnt Inference for Closed Systems with Hamiltonian Dynamics
- Denoising, deconvolving, and decomposing photon observations
- Nonequilibrium fluctuation theorems in the presence of a time-reversal symmetry-breaking field and nonconservative forces
- Maximum-Entropy Priors with Derived Parameters in a Specified Distribution
- Thermodynamic forces, flows, and Onsager coefficients in complex networks
- The statistics of mesoscopic systems and the physical interpretation of extensive and non-extensive entropies
- Non-equilibrium Dynamics, Thermalization and Entropy Production
- Signatures of integrability in the dynamics of Rydberg-blockaded chains
- Relative entropic uncertainty relation for scalar quantum fields
- Inconsistency in theories of violent relaxation
- Likely Cavitation in Stochastic Elasticity
- Beyond Inverse Ising Model: Structure of the Analytical Solution
- Information channel capacity in the field theory estimation
- Thermodynamics as a Consequence of Information Conservation
- On statistical properties of Jizba–Arimitsu hybrid entropy
- Inverse problem for multispecies ferromagneticlike mean-field models in phase space with many states
- Host-to-host variation of ecological interactions in polymicrobial infections
- Discrete Fluctuations in Memory Erasure without Energy Cost
- Information field theory for cosmological perturbation reconstruction and nonlinear signal analysis
- Discrete black-hole radiation and the information loss paradox
- Wehrl entropy, entropic uncertainty relations, and entanglement
- The Born rule and logical inference in quantum mechanics
- Parsimonious modeling with information filtering networks
- Quantum dynamics as a physical resource
- Multivariate quadrature for representing cloud condensation nuclei activity of aerosol populations
- Universality in an information-theoretic motivated nonlinear Schrodinger equation
- Equilibration and GGE in interacting-to-free quantum quenches in dimensions d\gt 1
- The Poincaré-Shannon Machine: Statistical Physics and Machine Learning Aspects of Information Cohomology
- Ising model [wikipedia]
- Kullback–Leibler divergence [wikipedia]
- Maximum entropy thermodynamics [wikipedia]
- Information: currency of life? [europepmc]
- Markov processes follow from the principle of maximum caliber. [europepmc]
- A derivation of the master equation from path entropy maximization. [europepmc]
- The workings of the maximum entropy principle in collective human behaviour. [europepmc]
- The use of climatic niches in screening procedures for introduced species to evaluate risk of spread: a case with the American Eastern grey squirrel. [europepmc]
- When do microcircuits produce beyond-pairwise correlations? [europepmc]
- Towards the Physics of Calcium Signalling in Plants. [europepmc]
- Non-stationary Bayesian estimation of parameters from a body cover model of the vocal folds. [europepmc]
- The Energy Landscape of Neurophysiological Activity Implicit in Brain Network Structure. [europepmc]
- Information theory, predictability and the emergence of complex life. [europepmc]
- Assessment of habitat suitability of the snow leopard ( Panthera uncia ) in Qomolangma National Nature Reserve based on MaxEnt modeling. [europepmc]
- A new class of entropic information measures, formal group theory and information geometry. [europepmc]
- The MIAmaxent R package: Variable transformation and model selection for species distribution models. [europepmc]
- The Price Equation Program: Simple Invariances Unify Population Dynamics, Thermodynamics, Probability, Information and Inference. [europepmc]
- Approximate Entropy and Sample Entropy: A Comprehensive Tutorial. [europepmc]
- Measures of Entropy to Characterize Fatigue Damage in Metallic Materials. [europepmc]
- The Role of Entropy in the Development of Economics. [europepmc]
- Entropy and the Brain: An Overview. [europepmc]
- The World as a Neural Network. [europepmc]
- Entropic Dynamics on Gibbs Statistical Manifolds. [europepmc]
- Information and Self-Organization II: Steady State and Phase Transition. [europepmc]
- Mapping habitat suitability for Asiatic black bear and red panda in Makalu Barun National Park of Nepal from Maxent and GARP models. [europepmc]
- Multiscale modeling of genome organization with maximum entropy optimization. [europepmc]
- Development, structure and mechanics of a synthetic E. coli outer membrane model. [europepmc]
- Reward Maximization Through Discrete Active Inference. [europepmc]
Related