2015/04/17 by Massimo Franceschetti, Franceschetti, Massimo, Taehyung J. Lim +1 · 1 citation
Computer Science · Engineering · Mathematics · #Chaos-based Image/Signal Encryption #Computability, Logic, AI Algorithms #FOS: Computer and information sciences #Information Theory (cs.IT) #Wireless Communication Security Techniques #cs.IT #math.IT
paper · pdf · doi:10.48550/arxiv.1504.04654
arxiv created 2015/04/17 · openalex publication_date 2015/04/17 · arxiv updated 2015/04/21 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
The deterministic notions of capacity and entropy are studied in the context of communication and storage of information using square-integrable, bandlimited signals subject to perturbation. The (ε,δ)-capacity, that extends the Kolmogorov ε-capacity to packing sets of overlap at most δ, is introduced and compared to the Shannon capacity. The functional form of the results indicates that in both Kolmogorov and Shannon's settings, capacity and entropy grow linearly with the number of degrees of freedom, but only logarithmically with the signal to noise ratio. This basic insight transcends the details of the stochastic or deterministic description of the information-theoretic model. For δ=0, the analysis leads to new bounds on the Kolmogorov ε-capacity, and to a tight asymptotic expression of the Kolmogorov ε-entropy of bandlimited signals. A deterministic notion of error exponent is introduced. Applications of the theory are briefly discussed.