2020/09/16 by Trung Nghia Vu, Trung Vu, Vu, Trung +4
Computer Science · Engineering · Mathematics · #15A06 (Primary) 65F06 (Secondary) #Advanced Adaptive Filtering Techniques #Blind Source Separation Techniques #FOS: Mathematics #Matrix Theory and Algorithms #Numerical Analysis (math.NA) #Statistics Theory (math.ST) #cs.NA #math.NA #math.ST #msc:15A06 #msc:65F06 #stat.TH
paper · pdf · doi:10.48550/arxiv.2009.07542
Accepted to Linear Algebra and Its Applications
openalex publication_date 2020/09/16 · arxiv created 2021/05/30 · arxiv updated 2021/06/01 · openalex created_date 2022/07/25 · openalex updated_date 2026/07/28
Truncated singular value decomposition is a reduced version of the singular value decomposition in which only a few largest singular values are retained. This paper presents a novel perturbation analysis for the truncated singular value decomposition for real matrices. First, we describe perturbation expansions for the singular value truncation of order r. We extend perturbation results for the singular subspace decomposition to derive the first-order perturbation expansion of the truncated operator about a matrix with rank greater than or equal to r. Observing that the first-order expansion can be greatly simplified when the matrix has exact rank r, we further show that the singular value truncation admits a simple second-order perturbation expansion about a rank-r matrix. Second, we introduce the first-known error bound on the linear approximation of the truncated singular value decomposition of a perturbed rank-r matrix. Our bound only depends on the least singular value of the unperturbed matrix and the norm of the perturbation matrix. Intriguingly, while the singular subspaces are known to be extremely sensitive to additive noises, the newly established error bound holds universally for perturbations with arbitrary magnitude. Finally, we demonstrate an application of our results to the analysis of the mean squared error associated with the TSVD-based matrix denoising solution.