Information Theory: A Tutorial Introduction

2018/02/16 by James V Stone, James V. Stone, Stone, James V · 2 voices · 1 citation
Neuroscience · #Cognitive Science and Education Research

paper · pdf · doi:10.48550/arxiv.1802.05968

Abstract

Shannon's mathematical theory of communication defines fundamental limits on how much information can be transmitted between the different components of any man-made or biological system. This paper is an informal but rigorous introduction to the main ideas implicit in Shannon's theory. An annotated reading list is provided for further reading.

Cited by

• Synergizing Reinforcement Learning and Genetic Algorithms for Neural Combinatorial Optimization

Discussions

• Information Theory: A Tutorial Introduction [hn, 297 points, 26 comments]
• arxiv.org/abs/1802.05968 [bsky, 0 points, 0 comments]

Related

• A Brief Introduction to Shannon's Information Theory
• Shannon information and integrated information: message and meaning
• A visual introduction to information theory
• Foundations of information theory for coding theory
• Understanding Shannon's Entropy metric for Information