vix.ing · top · new · best · stats · spec

No Cross-Validation Required: An Analytical Framework for Regularized Mixed-Integer Problems (Extended Version)

2020/08/04 by Behrad Soleimani, Soleimani, Behrad, Behzad Khamidehi +3
Computer Science · Decision Sciences · Mathematics · #Advanced Multi-Objective Optimization Algorithms #Advanced Optimization Algorithms Research #Applied mathematics #Computer science #Cross-validation #Econometrics #FOS: Computer and information sciences #FOS: Mathematics #Integer (computer science) #Integer programming #Mathematical optimization #Mathematics #Optimization and Control (math.OC) #Other Computer Science (cs.OH) #Probabilistic and Robust Engineering Design #Statistics #cs.OH #math.OC

paper · pdf · doi:10.48550/arxiv.2008.01292

arxiv created 2020/08/04 · openalex publication_date 2020/08/04 · arxiv updated 2020/08/05 · openalex created_date 2020/08/10 · openalex updated_date 2026/07/28

Abstract

This paper develops a method to obtain the optimal value for the regularization coefficient in a general mixed-integer problem (MIP). This approach eliminates the cross-validation performed in the existing penalty techniques to obtain a proper value for the regularization coefficient. We obtain this goal by proposing an alternating method to solve MIPs. First, via regularization, we convert the MIP into a more mathematically tractable form. Then, we develop an iterative algorithm to update the solution along with the regularization (penalty) coefficient. We show that our update procedure guarantees the convergence of the algorithm. Moreover, assuming the objective function is continuously differentiable, we derive the convergence rate, a lower bound on the value of regularization coefficient, and an upper bound on the number of iterations required for the convergence. We use a radio access technology (RAT) selection problem in a heterogeneous network to benchmark the performance of our method. Simulation results demonstrate near-optimality of the solution and consistency of the convergence behavior with obtained theoretical bounds.

Citations

Related