vix.ing · top · new · best · stats · spec

Informational Divergence Approximations to Product Distributions

2013/02/01 by Hou, Jie, Kramer, Gerhard
#FOS: Computer and information sciences #Information Theory (cs.IT)

paper · doi:10.48550/arxiv.1302.0215

Abstract

The minimum rate needed to accurately approximate a product distribution based on an unnormalized informational divergence is shown to be a mutual information. This result subsumes results of Wyner on common information and Han-Verdú on resolvability. The result also extends to cases where the source distribution is unknown but the entropy is known.

Related