Non-monotone Continuous DR-submodular Maximization: Structure and Algorithms

11/04/2017
by   An Bian, et al.
0

DR-submodular continuous functions are important objectives with wide real-world applications spanning MAP inference in determinantal point processes (DPPs), and mean-field inference for probabilistic submodular models, amongst others. DR-submodularity captures a subclass of non-convex functions that enables both exact minimization and approximate maximization in polynomial time. In this work we study the problem of maximizing non-monotone DR-submodular continuous functions under general down-closed convex constraints. We start by investigating geometric properties that underlie such objectives, e.g., a strong relation between (approximately) stationary points and global optimum is proved. These properties are then used to devise two optimization algorithms with provable guarantees. Concretely, we first devise a "two-phase" algorithm with 1/4 approximation guarantee. This algorithm allows the use of existing methods for finding (approximately) stationary points as a subroutine, thus, harnessing recent progress in non-convex optimization. Then we present a non-monotone Frank-Wolfe variant with 1/e approximation guarantee and sublinear convergence rate. Finally, we extend our approach to a broader class of generalized DR-submodular continuous functions, which captures a wider spectrum of applications. Our theoretical findings are validated on synthetic and real-world problem instances.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2020

Continuous Submodular Function Maximization

Continuous submodular functions are a category of generally non-convex/n...
research
05/19/2018

Optimal DR-Submodular Maximization and Applications to Provable Mean Field Inference

Mean field inference in probabilistic models is generally a highly nonco...
research
12/18/2019

Provable Non-Convex Optimization and Algorithm Validation via Submodularity

Submodularity is one of the most well-studied properties of problem clas...
research
01/09/2021

Rate Allocation and Content Placement in Cache Networks

We introduce the problem of optimal congestion control in cache networks...
research
07/13/2023

Continuous Non-monotone DR-submodular Maximization with Down-closed Convex Constraint

We investigate the continuous non-monotone DR-submodular maximization pr...
research
06/01/2020

From Sets to Multisets: Provable Variational Inference for Probabilistic Integer Submodular Models

Submodular functions have been studied extensively in machine learning a...
research
03/03/2019

Bounding Inefficiency of Equilibria in Continuous Actions Games using Submodularity and Curvature

Games with continuous strategy sets arise in several machine learning pr...

Please sign up or login with your details

Forgot password? Click here to reset