A note on the entropy of repetitive sequences of symmetry group permutations

2010/04/08 by Reginald D. Smith, Smith, Reginald D.
Biochemistry, Genetics and Molecular Biology · Computer Science · Mathematics · #Fractal and DNA sequence analysis #Machine Learning in Bioinformatics #cs.IT #math.IT

paper · pdf · doi:10.48550/arxiv.1004.1399

Paper has been witdrawn pending corrections to equations and formalism; 3 pages, no figures

arxiv created 2010/07/13 · arxiv updated 2010/07/14

Abstract

The paper makes the observation that all orders of information entropy are equal in signals composed of repeating units of distinct symbols where the units can be classified as a member of a symmetry group. This leads to an improved metric for measuring the information content of higher order entropies in data such as text, signals, or genetics and another measure of similarity to compare the incremental information content across entropy orders when comparing data of different sizes and symbol sets or when comparing entire sequences.

Related

• The Group Theoretic Roots of Information: permutations, symmetry, and entropy
• Information Measures for Entropy and Symmetry
• Diversity Assessment Based on a Higher Similarity-Higher Entropy Relation after Rejection of Gibbs Paradox
• Patterns of i.i.d. Sequences and Their Entropy - Part I: General Bounds
• Dynamic entropies, long-range correlations, and fluctuations in complex linear structures