2017/12/11 by Peter McCullagh, McCullagh, Peter, Nicholas Polson +1 · 1 citation
Computer Science · Engineering · Physics and Astronomy · #FOS: Computer and information sciences #Image and Signal Denoising Methods #Methodology (stat.ME) #Sparse and Compressive Sensing Techniques #Statistical Mechanics and Entropy
paper · pdf · doi:10.48550/arxiv.1712.03889
openalex publication_date 2017/12/11 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
The main contribution of this paper is a mathematical definition of statistical sparsity, which is expressed as a limiting property of a sequence of probability distributions. The limit is characterized by an exceedance measure~H and a rate parameter~ρ> 0, both of which are unrelated to sample size. The definition is sufficient to encompass all sparsity models that have been suggested in the signal-detection literature. Sparsity implies that ρ~is small, and a sparse approximation is asymptotic in the rate parameter, typically with error o(ρ) in the sparse limit ρ→ 0. To first order in sparsity, the sparse signal plus Gaussian noise convolution depends on the signal distribution only through its rate parameter and exceedance measure. This is one of several asymptotic approximations implied by the definition, each of which is most conveniently expressed in terms of the zeta-transformation of the exceedance measure. One implication is that two sparse families having the same exceedance measure are inferentially equivalent, and cannot be distinguished to first order. A converse implication for methodological strategy is that it may be more fruitful to focus on the exceedance measure, ignoring aspects of the signal distribution that have negligible effect on observables and on inferences. From this point of view, scale models and inverse-power measures seem particularly attractive.