Ideal spatial adaptation by wavelet shrinkage
1994/09/01 by David L Donoho, David L. Donoho, Iain M Johnstone +1 · 158 citations
Engineering · Computer Science · Mathematics · #Sparse and Compressive Sensing Techniques #Image and Signal Denoising Methods #Statistical Methods and Inference
paper · doi:10.1093/biomet/81.3.425
Abstract
With ideal spatial adaptation, an oracle furnishes information about how best to adapt a spatially variable estimator, whether piecewise constant, piecewise polynomial, variable knot spline, or variable bandwidth kernel, to the unknown function. Estimation with the aid of an oracle o ers dramatic advantages over traditional linear estimation by nonadaptive kernels � however, it is a priori unclear whether such performance can be obtained by a procedure relying on the data alone. We describe a new principle for spatially-adaptive estimation: selective wavelet reconstruction. Weshowthatvariableknot spline ts and piecewise-polynomial ts, when equipped with an oracle to select the knots, are not dramatically more powerful than selective wavelet reconstruction with an oracle. We develop a practical spatially adaptive method, RiskShrink, which works by shrinkage of empirical wavelet coe cients. RiskShrink mimics the performance of an oracle for selective wavelet reconstruction as well as it is possible to do so. A new inequality inmultivariate normal decision theory which wecallthe oracle inequality shows that attained performance di ers from ideal performance by at most a factor 2logn, where n is the sample size. Moreover no estimator can give a better guarantee than this. Within the class of spatially adaptive procedures, RiskShrink is essentially optimal. Relying only on the data, it comes within a factor log 2 n of the performance of piecewise polynomial and variable-knot spline methods equipped with an oracle. In contrast, it is unknown how or if piecewise polynomial methods could be made to function this well when denied access to an oracle and forced to rely on data alone.
Cited by
- Separation of seismic multiple reflection-refraction based on morphological component analysis with high-resolution linear Radon transform
- A Practical Guide to Wavelet Analysis
- Automatic microseismic denoising and onset detection using the synchrosqueezed continuous wavelet transform
- EMD-Based Signal Filtering
- Applicability of independent component analysis on high-density microelectrode array recordings
- Bayesian decomposition using Besov priors
- Wavelet transforms and their applications to MHD and plasma turbulence: a review
- From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
- Variable selection in robust regression models for longitudinal data
- Nearly unbiased variable selection under minimax concave penalty
- End-to-end meta-imagers: Information-theoretic objectives and generalized focusing optima
- The composite absolute penalties family for grouped and hierarchical variable selection
- The Dantzig selector: Statistical estimation when p is much larger than n
- Least angle regression
- On the adaptive elastic-net with a diverging number of parameters
- Drift-Aware RL-based Wavelet Denoising for Network-Traffic Anomaly Detection
- Variational Bayesian Sparse Negative Binomial Regression
- Covariance regularization by thresholding
- Image Denoising Using Global and Local Circulant Representation
- Domain general noise reduction for time series signals with Noisereduce
- Eigentriads and Eigenprogressions on the Tonnetz
- Regularization with the Smooth-Lasso procedure
- Multi-Focus Image Fusion Using Sparse Representation and Coupled Dictionary Learning
- A spatio-spectral hybridization for edge preservation and noisy image restoration via local parametric mixtures and Lagrangian relaxation
- Wavelet Integrated CNNs for Noise-Robust Image Classification
- Approximate Recovery in Changepoint Problems, from ℓ2 Estimation Error Rates
- Graph-Based Manifold Frequency Analysis for Denoising
- Flexible signal denoising via flexible empirical Bayes shrinkage
- Towards Sharp Minimax Risk Bounds for Operator Learning
- Forecasting Excessive Anesthesia Depth Using EEG α-Spindle Dynamics and Machine Learning
- Atangana-Baleanu Regularized Wavelet Compression For Astronomical Time-Series
- Wavelet-Packet-based Noise Signatures With Higher-Order Statistics for Anomaly Prediction
- Adaptive Basis Selection for Exponential Family Smoothing Splines with Application in Joint Modeling of Multiple Sequencing Samples
- Adaptive Nonparametric Estimation via Kernel Transport on Group Orbits: Oracle Inequalities and Minimax Rates
- POCS-enhanced correction of motion artifacts in parallel MRI
- Cuffless Blood Pressure Estimation from Six Wearable Sensor Modalities in Multi-Motion-State Scenarios
- New Perspectives on Frontal Variability in the Southern Ocean Using a\n Local Identification Scheme
- GCMCG: A Clustering-Aware Graph Attention and Expert Fusion Network for Multi-Paradigm, Multi-task, and Cross-Subject EEG Decoding
- A Space-Efficient Method for Navigable Ensemble Analysis and Visualization
- Convergence of cyclic coordinatewise l1 minimization
- Survival Modeling of Suicide Risk with Rare and Uncertain Diagnoses
- Quantum Framework for Wavelet Shrinkage
- Sparse Distance Weighted Discrimination
- Adaptive Thresholding for Sparse Covariance Matrix Estimation
- Exponential Lasso: robust sparse penalization under heavy-tailed noise and outliers with exponential-type loss
- Performance Bounds for Sparse Parametric Covariance Estimation in\n Gaussian Models
- A redescending-weight curvature regularization model for edge-preserving signal denoising
- Separation and Concentration in Deep Networks
- Short term load forecasting using wavelet transform combined with Holt–Winters and weighted nearest neighbor models
- Is Pessimism Provably Efficient for Offline RL?
- Joint Bilateral Filter for Signal Recovery from Phase Preserved Curvelet Coefficients for Image Denoising
- Registration-Free Monitoring of Unstructured Point Cloud Data via Intrinsic Geometrical Properties
- Atomic norm denoising with applications to line spectral estimation
- Efficient Solvers for SLOPE in R, Python, Julia, and C++
- Deviation Bounds for Wavelet Shrinkage
- Enhancing ECG Classification Robustness with Lightweight Unsupervised Anomaly Detection Filters
- Adaptive Risk Bounds in Univariate Total Variation Denoising and Trend Filtering
- Quaternion higher-order singular value decomposition and its applications in color image processing
- Robust Reduced Rank Regression
- A Minimum Description Length Approach to Multitask Feature Selection
- Windowed total variation denoising and noise variance monitoring
- Besov regularity of functions with sparse random wavelet coefficients
- Parameter-free and fast nonlinear piecewise filtering. Application to\n experimental physics
- An automatic channel selection method based on the standard deviation of wavelet coefficients for motor imagery based brain–computer interfacing
- Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
- A ROAD to Classification in High Dimensional Space
- Wavelet Shrinkage Denoising Using the Non-Negative Garrote
- Deep Recurrent Neural Networks for ECG Signal Denoising
- Removing Mixture of Gaussian and Impulse Noise by Patch-Based Weighted Means
- What needles do sparse neural networks find in nonlinear haystacks
- Fully Bayesian Estimation and Variable Selection in Partially Linear Wavelet Models
- Signal Detection in Singular Value Decomposition
- Benchmarking Neural Network Robustness to Common Corruptions and Surface Variations
- Agent-Based Optimal Control for Image Processing
- Proximal Hamiltonian Monte Carlo
- Battery Lifetime Prognostics
- Beyond sparse denoising in frames: minimax estimation with a scattering transform
- Survival of the fittest Cox model: Pivotal variable selection for time-to-event data
- Robust Nonparametric Regression with Deep Neural Networks
- Lasso Meets Horseshoe: A Survey
- SDPA++: A General Framework for Self-Supervised Denoising with Patch Aggregation
- Fitting an Escalier to a Curve
- Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude\n Pruning
- Matrix-free Interior Point Method for Compressed Sensing Problems
- Minimax adaptive wavelet estimator for the anisotropic functional deconvolution model with unknown kernel
- The evolution of high-order genome architecture revealed from 1,000 species
- The path of hyperinterpolation: A survey
- Fast Feature Field (F3): A Predictive Representation of Events
- Image Processing Tools for Financial Time Series Classification
- Optimal Sampling Density for Nonparametric Regression
- Learning attentional templates for value-based decision-making
- Sharp RIP bound for sparse signal and low-rank matrix recovery
- Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictors
- Multiscale regression on unknown manifolds
- Minimax wavelet estimation for multisample heteroscedastic\n non-parametric regression
- A dynamic programming approach for generalized nearly isotonic optimization
- Optimal Bias-variance Tradeoff in Matrix and Tensor Estimation
- Nonparametric Bayesian Classification
- Deep Learning Architectures for Medical Image Denoising: A Comparative Study of CNN-DAE, CADTra, and DCMIEDNet
- Near-Linear Time Local Polynomial Nonparametric Estimation with Box Kernels
- Statistical Challenges with High Dimensionality: Feature Selection in Knowledge Discovery
- Real-Time Fault Detection and Process Control Based on Multi-channel Sensor Data Fusion
- Advancing Few-Shot Pediatric Arrhythmia Classification with a Novel Contrastive Loss and Multimodal Learning
- Adaptive Density Estimation Using Projection Kernels and Penalized Comparison to Overfitting
- Exponential Screening and optimal rates of sparse estimation
- Nonconcave penalized likelihood with a diverging number of parameters
- Solving Imaging Inverse Problems Using Plug-and-Play Denoisers: Regularization and Optimization Perspectives
- Volatility Dynamics of Wavelet-Filtered Stock Prices
- GPR signal de-noising by discrete wavelet transform
- Regularization by Denoising: Clarifications and New Interpretations
- High-Dimensional Spatial Autoregression with Latent Factors by Diversified Projections
- Signal Lasso with Non-Convex Penalties for Efficient Network Reconstruction and Topology Inference
- Enhanced long-duration gravitational-wave transient sources search pipeline with denoising and tree clustering algorithms
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- Block Coordinate Relaxation Methods for Nonparametric Wavelet Denoising
- The Discrete Wavelet Transform in S
- Systematic Evaluation of Wavelet-Based Denoising for MRI Brain Images: Optimal Configurations and Performance Benchmarks
- The restricted consistency property of leave-nv-out cross-validation for high-dimensional variable selection
- Wavelets for power spectral density estimation of gravitational wave data
- Neuron segmentation using 3D wavelet integrated encoder-decoder network
- Efficient Image Denoising Using Global and Local Circulant Representation
- Generating Training Data for Denoising Real RGB Images via Camera Pipeline Simulation
- Sparse and redundant signal representations for x-ray computed tomography
- Revisit 1D Total Variation restoration problem with new real-time algorithms for signal and hyper-parameter estimations
- On Noise-Sensitive Automatic Tuning of Gate-Defined Sensor Dots
- The Relative Instability of Model Comparison with Cross-validation
- SUNLayer: Stable denoising with generative networks
- Approximate l0-penalized estimation of piecewise-constant signals on graphs
- Denoising and compression in wavelet domain via projection onto approximation coefficients
- Adaptive estimation of spectral densities via wavelet thresholding and information projection
- Scalable SUM-Shrinkage Schemes for Distributed Monitoring Large-Scale Data Streams
- Diffusion Denoiser-Aided Gyrocompassing
- Time-to-Event Modeling with Pseudo-Observations in Federated Settings
- Stepwise regression [wikipedia]
- CMA: a comprehensive Bioconductor package for supervised classification with high dimensional data. [europepmc]
- Low-dose computed tomography image restoration using previous normal-dose scan. [europepmc]
- Independent Principal Component Analysis for biologically meaningful dimension reduction of large biological data sets. [europepmc]
- Arcuate hypothalamic AgRP and putative POMC neurons show opposite changes in spiking across multiple timescales. [europepmc]
- Phenotypic and Functional Characterization of Peripheral Sensory Neurons derived from Human Embryonic Stem Cells. [europepmc]
- Mapping molecular assemblies with fluorescence microscopy and object-based spatial statistics. [europepmc]
- The Harvard Automated Processing Pipeline for Electroencephalography (HAPPE): Standardized Processing Software for Developmental and High-Artifact Data. [europepmc]
- Putative dopamine neurons in the ventral tegmental area enhance information coding in the prefrontal cortex. [europepmc]
- Spike sorting based on shape, phase, and distribution features, and K-TOPS clustering with validity and error indices. [europepmc]
- Traction force microscopy with optimized regularization and automated Bayesian parameter selection for comparing cells. [europepmc]
- Dynamic Imaging of Glucose and Lactate Metabolism by 13 C-MRS without Hyperpolarization. [europepmc]
- An interactive ImageJ plugin for semi-automated image denoising in electron microscopy. [europepmc]
- Brief review of image denoising techniques. [europepmc]
- Acetylcholine acts on songbird premotor circuitry to invigorate vocal output. [europepmc]
- Regularization and error characterization of GRACE mascons. [europepmc]
- TNFα induces mitochondrial fragmentation and biogenesis in human airway smooth muscle. [europepmc]
- Travelling spindles create necessary conditions for spike-timing-dependent plasticity in humans. [europepmc]
- Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network. [europepmc]
- Denoising of hyperpolarized 13 C MR images of the human brain using patch-based higher-order singular value decomposition. [europepmc]
- Image Denoising Using a Compressive Sensing Approach Based on Regularization Constraints. [europepmc]
- PPG2ABP: Translating Photoplethysmogram (PPG) Signals to Arterial Blood Pressure (ABP) Waveforms. [europepmc]
- A photoacoustic patch for three-dimensional imaging of hemoglobin and core temperature. [europepmc]
- Reducing Noise, Artifacts and Interference in Single-Channel EMG Signals: A Review. [europepmc]
- Induced neural phase precession through exogenous electric fields. [europepmc]
- A review on spectral data preprocessing techniques for machine learning and quantitative analysis. [europepmc]
Related