vix.ing · top · new · best · stats · spec

Is the Information Entropy the Same as the Statistical Mechanical\n Entropy?

2012/09/25 by Phil Attard, Attard, Phil
Physics and Astronomy · Computer Science · #Statistical Mechanics and Entropy #Advanced Thermodynamics and Statistical Mechanics #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.1209.5500

Abstract

It is shown that the standard expression for the information entropy,\noriginally due to Shannon, is only valid for a particular set of states. For\nthe general case of statistical mechanics, one needs to include an additional\nterm in the expression for the entropy as a function of the probability. A\nsimple derivation of the general formula is given.\n

Related