2025/01/06 by Koriyama, Takuya, Bellec, Pierre C.
#FOS: Mathematics #Statistics Theory (math.ST)
paper · doi:10.48550/arxiv.2501.03163
This paper studies phase transitions for the existence of unregularized M-estimators under proportional asymptotics where the sample size n and feature dimension p grow proportionally with n/p → δ∈ (1, ∞). We study the existence of M-estimators in single-index models where the response yi depends on covariates xi ∼ N(0, Ip) through an unknown index w ∈ ℝp and an unknown link function. An explicit expression is derived for the critical threshold δ_∞ that determines the phase transition for the existence of the M-estimator, generalizing the results of Candés & Sur (2020) for binary logistic regression to other single-index models. Furthermore, we investigate the existence of a solution to the nonlinear system of equations governing the asymptotic behavior of the M-estimator when it exists. The existence of solution to this system for δ> δ_∞ remains largely unproven outside the global null in binary logistic regression. We address this gap with a proof that the system admits a solution if and only if δ> δ_∞, providing a comprehensive theoretical foundation for proportional asymptotic results that require as a prerequisite the existence of a solution to the system.