Self-supervised Equality Embedded Deep Lagrange Dual for Approximate Constrained Optimization

06/11/2023
by   Minsoo Kim, et al.
0

Conventional solvers are often computationally expensive for constrained optimization, particularly in large-scale and time-critical problems. While this leads to a growing interest in using neural networks (NNs) as fast optimal solution approximators, incorporating the constraints with NNs is challenging. In this regard, we propose deep Lagrange dual with equality embedding (DeepLDE), a framework that learns to find an optimal solution without using labels. To ensure feasible solutions, we embed equality constraints into the NNs and train the NNs using the primal-dual method to impose inequality constraints. Furthermore, we prove the convergence of DeepLDE and show that the primal-dual learning method alone cannot ensure equality constraints without the help of equality embedding. Simulation results on convex, non-convex, and AC optimal power flow (AC-OPF) problems show that the proposed DeepLDE achieves the smallest optimality gap among all the NN-based approaches while always ensuring feasible solutions. Furthermore, the computation time of the proposed method is about 5 to 250 times faster than DC3 and the conventional solvers in solving constrained convex, non-convex optimization, and/or AC-OPF.

READ FULL TEXT
research
02/25/2018

Gradient Primal-Dual Algorithm Converges to Second-Order Stationary Solutions for Nonconvex Distributed Optimization

In this work, we study two first-order primal-dual based algorithms, the...
research
07/17/2023

RAYEN: Imposition of Hard Convex Constraints on Neural Networks

This paper presents RAYEN, a framework to impose hard convex constraints...
research
04/25/2021

DC3: A learning method for optimization with hard constraints

Large optimization problems with hard constraints arise in many settings...
research
09/24/2012

A New Continuous-Time Equality-Constrained Optimization Method to Avoid Singularity

In equality-constrained optimization, a standard regularity assumption i...
research
07/30/2013

Efficient Energy Minimization for Enforcing Statistics

Energy minimization algorithms, such as graph cuts, enable the computati...
research
07/24/2018

A Convex Formulation for Binary Tomography

Binary tomography is concerned with the recovery of binary images from a...
research
03/08/2021

Constrained Learning with Non-Convex Losses

Though learning has become a core technology of modern information proce...

Please sign up or login with your details

Forgot password? Click here to reset