2019/05/28 by Yijun Zuo, Zuo, Yijun
Decision Sciences · Mathematics · #62G08 (Primary) #62J05 #62J99 (Secondary) #Advanced Statistical Methods and Models #Advanced Statistical Process Monitoring #Computation (stat.CO) #FOS: Computer and information sciences #Optimal Experimental Design Methods
paper · pdf · doi:10.48550/arxiv.1905.11846
openalex publication_date 2019/05/28 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Notions of depth in regression have been introduced and studied in the literature. The most famous example is Regression Depth (RD), which is a direct extension of location depth to regression. The projection regression depth (PRD) is the extension of another prevailing location depth, the projection depth, to regression. The computation issues of the RD have been discussed in the literature. The computation issues of the PRD have never been dealt with before. The computation issues of the PRD and its induced median (maximum depth estimator) in a regression setting are addressed now. For a given \bsβ∈\Rp exact algorithms for the PRD with cost O(n2log n) (p=2) and O(N(n, p)(p3+nlog n+np1.5+npNIter)) (p>2) and approximate algorithms for the PRD and its induced median with cost respectively O(N_\mbvnp) and O(Rp N\bsβ(p2+nN_\mbvNIter)) are proposed. Here N(n, p) is a number defined based on the total number of (p-1) dimensional hyperplanes formed by points induced from sample points and the \bsβ; N_\mbv is the total number of unit directions \mbv utilized; N\bsβ is the total number of candidate regression parameters \bsβ employed; NIter is the total number of iterations carried out in an optimization algorithm; R is the total number of replications. Furthermore, as the second major contribution, three PRD induced estimators, which can be computed up to 30 times faster than that of the PRD induced median while maintaining a similar level of accuracy are introduced. Examples and simulation studies reveal that the depth median induced from the PRD is favorable in terms of robustness and efficiency, compared to the maximum depth estimator induced from the RD, which is the current leading regression median.