2014/04/08 by Jonathon Shlens, Shlens, Jonathon
Computer Science · Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #Chaos, Complexity, and Education #FOS: Computer and information sciences #Information Theory (cs.IT) #Statistical Mechanics and Entropy
paper · pdf · doi:10.48550/arxiv.1404.1998
openalex publication_date 2014/04/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
The expression for entropy sometimes appears mysterious - as it often is asserted without justification. This short manuscript contains a discussion of the underlying assumptions behind entropy as well as simple derivation of this ubiquitous quantity.