Fighting the curse of dimensionality: A machine learning approach to finding global optima

10/28/2021
by   Julian F. Schumann, et al.
0

Finding global optima in high-dimensional optimization problems is extremely challenging since the number of function evaluations required to sufficiently explore the design space increases exponentially with its dimensionality. Furthermore, non-convex cost functions render local gradient-based search techniques ineffective. To overcome these difficulties, here we demonstrate the use of machine learning to find global minima, whereby autoencoders are used to drastically reduce the search space dimensionality, and optima are found by surveying the lower-dimensional latent spaces. The methodology is tested on benchmark functions and on a structural optimization problem, where we show that by exploiting the behavior of certain cost functions we either obtain the global optimum at best or obtain superior results at worst when compared to established optimization procedures.

READ FULL TEXT

page 9

page 14

page 41

research
03/24/2021

Why Do Local Methods Solve Nonconvex Problems?

Non-convex optimization is ubiquitous in modern machine learning. Resear...
research
12/22/2020

Finding Global Minima via Kernel Approximations

We consider the global minimization of smooth functions based solely on ...
research
12/18/2020

Multiscale semidefinite programming approach to positioning problems with pairwise structure

We consider the optimization of pairwise objective functions, i.e., obje...
research
01/30/2019

An approximate Itô-SDE based simulated annealing algorithm for multivariate design optimization problems

This research concerns design optimization problems involving numerous d...
research
08/21/2018

Search for Common Minima in Joint Optimization of Multiple Cost Functions

We present a novel optimization method, named the Combined Optimization ...
research
05/22/2018

Neural Generative Models for Global Optimization with Gradients

The aim of global optimization is to find the global optimum of arbitrar...
research
08/09/2020

Global Optimum Search in Quantum Deep Learning

This paper aims to solve machine learning optimization problem by using ...

Please sign up or login with your details

Forgot password? Click here to reset