2012/03/23 by Matthias Scholz
Chemistry · Computer Science · Engineering · Mathematics · #Fault Detection and Control Systems #Neural Networks and Applications #Spectroscopy and Chemometric Analyses #cs.AI #cs.CV #cs.LG #stat.ML
paper · pdf · doi:10.1007/s11063-012-9220-6
published as Neural Processing Letters, 2012 · 12 pages, 5 figures
openalex publication_date 2012/03/23 · arxiv created 2012/04/03 · arxiv updated 2012/04/04 · openalex created_date 2016/06/24 · openalex updated_date 2026/07/29
Linear principal component analysis (PCA) can be extended to a nonlinear PCA by using artificial neural networks. But the benefit of curved components requires a careful control of the model complexity. Moreover, standard techniques for model selection, including cross-validation and more generally the use of an independent test set, fail when applied to nonlinear PCA because of its inherent unsupervised characteristics. This paper presents a new approach for validating the complexity of nonlinear PCA models by using the error in missing data estimation as a criterion for model selection. It is motivated by the idea that only the model of optimal complexity is able to predict missing values with the highest accuracy. While standard test set validation usually favours over-fitted nonlinear PCA models, the proposed model validation approach correctly selects the optimal model complexity.