2011/07/18 by Tommaso Cai, Tony Cai, Weidong Liu +2 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Face and Expression Recognition #Gene expression and cancer classification #Methodology (stat.ME) #Sparse and Compressive Sensing Techniques #Statistics Theory (math.ST) #math.ST #stat.ME #stat.TH
paper · pdf · doi:10.48550/arxiv.1107.3442
39 pages.To appear in Journal of the American Statistical Association
arxiv created 2011/07/18 · openalex publication_date 2011/07/18 · arxiv updated 2011/07/19 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
This paper considers sparse linear discriminant analysis of high-dimensional data. In contrast to the existing methods which are based on separate estimation of the precision matrix Ø and the difference \de of the mean vectors, we introduce a simple and effective classifier by estimating the product Ø\de directly through constrained ℓ1 minimization. The estimator can be implemented efficiently using linear programming and the resulting classifier is called the linear programming discriminant (LPD) rule. The LPD rule is shown to have desirable theoretical and numerical properties. It exploits the approximate sparsity of Ø\de and as a consequence allows cases where it can still perform well even when Ø and/or \de cannot be estimated consistently. Asymptotic properties of the LPD rule are investigated and consistency and rate of convergence results are given. The LPD classifier has superior finite sample performance and significant computational advantages over the existing methods that require separate estimation of Ø and \de. The LPD rule is also applied to analyze real datasets from lung cancer and leukemia studies. The classifier performs favorably in comparison to existing methods.