Effect of Activity and Inter-Cluster Correlations on Information-Theoretic Properties of Neural Networks

2014/11/06 by Andrey Demichev, Demichev, Andrey
Biochemistry, Genetics and Molecular Biology · Computer Science · Neuroscience · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Biological sciences #FOS: Physical sciences #Neural Networks and Applications #Neural dynamics and brain function #Neurons and Cognition (q-bio.NC) #cond-mat.dis-nn #q-bio.NC #stochastic dynamics and bifurcation

paper · pdf · doi:10.48550/arxiv.1411.1612

16 pages, 9 figures

arxiv created 2014/11/06 · openalex publication_date 2014/11/06 · arxiv updated 2014/11/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

On the basis of solutions of the master equation for networks with a small number of neurons it is shown that the conditional entropy and integrated information of neural networks depend on their average activity and inter-cluster correlations.

Related

• Entropy, mutual information, and systematic measures of structured spiking neural networks
• Neuronal Correlation: a Central Concept in Neural Network
• An analytically tractable model of neural population activity in the presence of common input explains higher-order correlations and entropy
• Methods for Estimating Neural Information
• Does a larger neural network mean greater information transmission efficiency?