A Mini-Introduction To Information Theory

2018/05/30 by Edward Witten · 4 voices · 109 citations
Physics and Astronomy · #Coherent information #Conditional entropy #Generalized relative entropy #Information theory #Joint quantum entropy #Quantum Mechanics and Applications #Quantum Mechanics and Non-Hermitian Physics #Quantum discord #Quantum information #Quantum mutual information #Quantum relative entropy #Statistical Mechanics and Entropy #Von Neumann entropy #hep-th #quant-ph

paper · pdf · doi:10.1007/s40766-020-00004-5

published in Rivista Del Nuovo Cimento 43(4), 187-227 (Springer Science+Business Media) · 39 pp, various small improvements in this version

openalex created_date 2018/06/13 · arxiv created 2019/10/04 · openalex publication_date 2020/03/23 · arxiv updated 2020/04/20 · openalex updated_date 2026/08/05

Abstract

This article consists of a very short introduction to classical and quantum information theory. Basic properties of the classical Shannon entropy and the quantum von Neumann entropy are described, along with related concepts such as classical and quantum relative entropy, conditional entropy, and mutual information. A few more detailed topics are considered in the quantum case.

Cited by

• Introduction to Black Hole Thermodynamics
• New conditions for multipartite entanglement wedge connectivity in n-to-n holographic scattering
• Digit anomalies in the hadronic mass spectrum, Shannon information entropy, and the dynamical QCD scale
• Gibbons-Hawking Entropy and BMN Strings
• Adaptive Base Representation Theorem: An Alternative to Binary Number System
• Information Shapes Koopman Representation
• The exact relation between the entanglement entropies of the XY and quantum Ising chains with free and fixed boundary conditions
• Positivity bounds from thermal field theory entropy
• Entanglement Entropy and Thermodynamics of Dynamical Black Holes
• Multipartite entanglement from ditstrings for 1+1D systems
• Quantum-inspired exoplanet detection in the presence of experimental imperfections
• DeepER-Med: Advancing Deep Evidence-Based Research in Medicine Through Agentic AI
• Monogamy and trade-off relations for correlated quantum coherence
• Off-diagonal cosmological solutions in emergent gravity theories and Grigory Perelman entropy for geometric flows
• Kaluza–Klein gravity and cosmology emerging from G. Perelman’s entropy functionals and quantum geometric information flows
• The ℏ→ 0 Limit of the Entanglement Entropy

Discussions

• A Mini-Introduction to Information Theory [hn, 136 points, 24 comments]
• A Mini-Introduction to Information Theory [hn, 3 points, 0 comments]
• Witten: An Intro to Quantum Information Theory [hn, 2 points, 0 comments]
• A Mini-Introduction to Information Theory by Edward Witten [hn, 2 points, 0 comments]

Related

• Quantum Information Theory
• Quantum Information Theory and Applications to Quantum Cryptography
• Relative entropy in quantum information theory
• Quantum Information Processing: An Essential Primer
• Considerations on Classical and Quantum Bits