vix.ing · top · new · best · stats · spec

Mixed linear-nonlinear least squares regression

2017/03/12 by Alberto Herrera‐Gómez, Herrera-Gomez, Alberto, R. Michael Porter +1
Chemistry · Engineering · Mathematics · #49M 65H 90C 93E (secondary) #65K (primary) #Control Systems and Identification #FOS: Mathematics #Optimization and Control (math.OC) #Spectroscopy and Chemometric Analyses #Statistical and numerical algorithms

paper · pdf · doi:10.48550/arxiv.1703.04181

openalex publication_date 2017/03/12 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The problem of fitting experimental data to a given model function f(t; p1,p2,…,pN) is conventionally solved numerically by methods such as that of Levenberg-Marquardt, which are based on approximating the Chi-squared measure of discrepancy by a quadratic function. Such nonlinear iterative methods are usually necessary unless the function f to be fitted is itself a linear function of the parameters pn, in which case an elementary linear Least Squares regression is immediately available. When linearity is present in some, but not all, of the parameters, we show how to streamline the optimization method by reducing the "nonlinear activity" to the nonlinear parameters only. Numerical examples are given to demonstrate the effectiveness of this approach. The main idea is to replace entries corresponding to the linear terms in the numerical difference quotients with an optimal value easily obtained by linear regression. More generally, the idea applies to minimization problems which are quadratic in some of the parameters. We show that the covariance matrix of χ2 remains the same even though the derivatives are calculated in a different way. For this reason, the standard non-linear optimization methods can be fully applied.

Citations

Related