vix.ing · top · new · best · stats · spec

A Provable Smoothing Approach for High Dimensional Generalized Regression with Applications in Genomics

2015/09/23 by Fang Han, Hongkai Ji, Han, Fang +5
Biochemistry, Genetics and Molecular Biology · Decision Sciences · Mathematics · #FOS: Computer and information sciences #Gene expression and cancer classification #Methodology (stat.ME) #Optimal Experimental Design Methods #Statistical Methods and Inference

paper · pdf · doi:10.48550/arxiv.1509.07158

openalex publication_date 2015/09/23 · openalex created_date 2017/07/31 · openalex updated_date 2026/07/28

Abstract

In many applications, linear models fit the data poorly. This article studies an appealing alternative, the generalized regression model. This model only assumes that there exists an unknown monotonically increasing link function connecting the response Y to a single index XTβ^* of explanatory variables X∈ℝd. The generalized regression model is flexible and covers many widely used statistical models. It fits the data generating mechanisms well in many real problems, which makes it useful in a variety of applications where regression models are regularly employed. In low dimensions, rank-based M-estimators are recommended to deal with the generalized regression model, giving root-n consistent estimators of β^*. Applications of these estimators to high dimensional data, however, are questionable. This article studies, both theoretically and practically, a simple yet powerful smoothing approach to handle the high dimensional generalized regression model. Theoretically, a family of smoothing functions is provided, and the amount of smoothing necessary for efficient inference is carefully calculated. Practically, our study is motivated by an important and challenging scientific problem: decoding gene regulation by predicting transcription factors that bind to cis-regulatory elements. Applying our proposed method to this problem shows substantial improvement over the state-of-the-art alternative in real data.

Citations

Related