2022/11/25 by Raaz Dwivedi, Katherine Tian, Dwivedi, Raaz +9 · 1 citation
Decision Sciences · Mathematics · #Advanced Statistical Methods and Models #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multi-Criteria Decision Making
paper · pdf · doi:10.48550/arxiv.2211.14297
openalex publication_date 2022/11/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
We introduce and analyze an improved variant of nearest neighbors (NN) for estimation with missing data in latent factor models. We consider a matrix completion problem with missing data, where the (i, t)-th entry, when observed, is given by its mean f(ui, vt) plus mean-zero noise for an unknown function f and latent factors ui and vt. Prior NN strategies, like unit-unit NN, for estimating the mean f(ui, vt) relies on existence of other rows j with uj ≈ ui. Similarly, time-time NN strategy relies on existence of columns t' with vt' ≈ vt. These strategies provide poor performance respectively when similar rows or similar columns are not available. Our estimate is doubly robust to this deficit in two ways: (1) As long as there exist either good row or good column neighbors, our estimate provides a consistent estimate. (2) Furthermore, if both good row and good column neighbors exist, it provides a (near-)quadratic improvement in the non-asymptotic error and admits a significantly narrower asymptotic confidence interval when compared to both unit-unit or time-time NN.