Entropy and Correlation: Some Comments

1987/01/01 by Tarald O. Kvalseth, Tarald O. Kvålseth · 16 citations
Computer Science · #Neural Networks and Applications

paper · doi:10.1109/tsmc.1987.4309069

Abstract

For measuring the degree of association or correlation between two nominal variables, a measure based on informational entropy is presented as being preferable to that proposed recently by Horibe [1]. Asymptotic developments are also presented that may be used for making approximate statistical inferences about the population measure when the sample size is reasonably large. The use of this methodology is illustrated using a numerical example.

Cited by

• Belief Network Analysis: A Relational Approach to Understanding the Structure of Attitudes
• Social Comparison without Explicit Inference of Others' Reward Values: A Constructive Approach Using a Probabilistic Generative Model
• Understanding partition comparison indices based on counting object pairs
• Mode-Aware Non-Linear Tucker Autoencoder for Tensor-based Unsupervised Learning
• Comparison of module detection algorithms in protein networks and investigation of the biological meaning of predicted modules. [europepmc]
• Core-periphery structure in directed networks. [europepmc]
• Inter-protein residue covariation information unravels physically interacting protein dimers. [europepmc]
• Cryogenian Origin and Subsequent Diversification of the Plant Cell-Wall Enzyme XTH Family. [europepmc]
• A fractal scaling analysis of the SARS-CoV-2 genome sequence. [europepmc]
• Image Registration in Longitudinal Bone Assessment Using Computed Tomography. [europepmc]
• Enhancing Exchange-Traded Fund Price Predictions: Insights from Information-Theoretic Networks and Node Embeddings. [europepmc]
• Hierarchical path planning from speech instructions with spatial concept-based topometric semantic mapping. [europepmc]
• Fusion of EEG and EMG signals for detecting pre-movement intention of sitting and standing in healthy individuals and patients with spinal cord injury. [europepmc]
• Perceptual Complexity as Normalized Shannon Entropy. [europepmc]
• Null models for comparing information decomposition across complex systems. [europepmc]
• deepBreaks identifies and prioritizes genotype-phenotype associations using machine learning. [europepmc]

Related

• Entropy rates in the dimension theory of self-similar measures
• The Boltzmann/Shannon entropy as a measure of correlation
• A Note on Mathai's Entropy Measure
• Entropy measures and their applications: A comprehensive review
• Shannon's entropy and its Generalizations towards Statistics, Reliability and Information Science during 1948-2018