2016/03/24 by Lahiri, Subhaneil, Sohl-Dickstein, Jascha, Ganguli, Surya
Biochemistry, Genetics and Molecular Biology · Computer Science · Mathematics · Physics and Astronomy · #Biological Physics (physics.bio-ph) #FOS: Biological sciences #FOS: Computer and information sciences #FOS: Physical sciences #Information Theory (cs.IT) #Machine Learning (stat.ML) #Neurons and Cognition (q-bio.NC) #Statistical Mechanics (cond-mat.stat-mech) #cond-mat.stat-mech #cs.IT #math.IT #physics.bio-ph #q-bio.NC #stat.ML
paper · pdf · doi:10.48550/arxiv.1603.07758
15 pages, 3 figures
Maximizing the speed and precision of communication while minimizing power dissipation is a fundamental engineering design goal. Also, biological systems achieve remarkable speed, precision and power efficiency using poorly understood physical design principles. Powerful theories like information theory and thermodynamics do not provide general limits on power, precision and speed. Here we go beyond these classical theories to prove that the product of precision and speed is universally bounded by power dissipation in any physical communication channel whose dynamics is faster than that of the signal. Moreover, our derivation involves a novel connection between friction and information geometry. These results may yield insight into both the engineering design of communication devices and the structure and function of biological signaling systems.