2023/07/19 by Dimitri J. Papageorgiou, Papageorgiou, Dimitri J., Jan Kronqvist +3 · 1 citation
Computer Science · Decision Sciences · #Advanced Multi-Objective Optimization Algorithms #FOS: Mathematics #Machine Learning and Data Classification #Optimal Experimental Design Methods #Optimization and Control (math.OC)
paper · pdf · doi:10.48550/arxiv.2307.10463
openalex publication_date 2023/07/19 · openalex created_date 2023/07/22 · openalex updated_date 2026/07/28
This paper describes a simple, but effective sampling method for optimizing and learning a discrete approximation (or surrogate) of a multi-dimensional function along a one-dimensional line segment of interest. The method does not rely on derivative information and the function to be learned can be a computationally-expensive ``black box'' function that must be queried via simulation or other means. It is assumed that the underlying function is noise-free and smooth, although the algorithm can still be effective when the underlying function is piecewise smooth. The method constructs a smooth surrogate on a set of equally-spaced grid points by evaluating the true function at a sparse set of judiciously chosen grid points. At each iteration, the surrogate's non-tabu local minima and maxima are identified as candidates for sampling. Tabu search constructs are also used to promote diversification. If no non-tabu extrema are identified, a simple exploration step is taken by sampling the midpoint of the largest unexplored interval. The algorithm continues until a user-defined function evaluation limit is reached. Numerous examples are shown to illustrate the algorithm's efficacy and superiority relative to state-of-the-art methods, including Bayesian optimization and NOMAD, on primarily nonconvex test functions.