Global Optimality in Bivariate Gradient-based DAG Learning

06/30/2023
by   Chang Deng, et al.
0

Recently, a new class of non-convex optimization problems motivated by the statistical problem of learning an acyclic directed graphical model from data has attracted significant interest. While existing work uses standard first-order optimization schemes to solve this problem, proving the global optimality of such approaches has proven elusive. The difficulty lies in the fact that unlike other non-convex problems in the literature, this problem is not "benign", and possesses multiple spurious solutions that standard approaches can easily get trapped in. In this paper, we prove that a simple path-following optimization scheme globally converges to the global minimum of the population loss in the bivariate setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/29/2018

Global Non-convex Optimization with Discretized Diffusions

An Euler discretization of the Langevin diffusion is known to converge t...
research
05/31/2022

Scalable Distributional Robustness in a Class of Non Convex Optimization with Guarantees

Distributionally robust optimization (DRO) has shown lot of promise in p...
research
05/31/2019

Testing that a Local Optimum of the Likelihood is Globally Optimum using Reparameterized Embeddings

Many mathematical imaging problems are posed as non-convex optimization ...
research
04/07/2023

Bounding Optimality Gaps for Non-Convex Optimization Problems: Applications to Nonlinear Safety-Critical Systems

Efficient methods to provide sub-optimal solutions to non-convex optimiz...
research
05/26/2023

Optimizing NOTEARS Objectives via Topological Swaps

Recently, an intriguing class of non-convex optimization problems has em...
research
04/07/2019

Every Local Minimum is a Global Minimum of an Induced Model

For non-convex optimization in machine learning, this paper proves that ...
research
09/09/2020

Meta-learning for Multi-variable Non-convex Optimization Problems: Iterating Non-optimums Makes Optimum Possible

In this paper, we aim to address the problem of solving a non-convex opt...

Please sign up or login with your details

Forgot password? Click here to reset