Batch greedy maximization of non-submodular functions: Guarantees and applications to experimental design

06/03/2020
by   Jayanth Jagalur-Mohan, et al.
0

We propose and analyze batch greedy heuristics for cardinality constrained maximization of non-submodular non-decreasing set functions. Our theoretical guarantees are characterized by the combination of submodularity and supermodularity ratios. We argue how these parameters define tight modular bounds based on incremental gains, and provide a novel reinterpretation of the classical greedy algorithm using the minorize-maximize (MM) principle. Based on that analogy, we propose a new class of methods exploiting any plausible modular bound. In the context of optimal experimental design for linear Bayesian inverse problems, we bound the submodularity and supermodularity ratios when the underlying objective is based on mutual information. We also develop novel modular bounds for the mutual information in this setting, and describe certain connections to polyhedral combinatorics. We discuss how algorithms using these modular bounds relate to established statistical notions such as leverage scores and to more recent efforts such as volume sampling. We demonstrate our theoretical findings on synthetic problems and on a real-world climate monitoring example.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 11

page 31

11/02/2020

Unified greedy approximability beyond submodular maximization

We consider classes of objective functions of cardinality constrained ma...
02/20/2018

Robust Maximization of Non-Submodular Objectives

We study the problem of maximizing a monotone set function subject to a ...
06/27/2020

Concave Aspects of Submodular Functions

Submodular Functions are a special class of set functions, which general...
06/17/2018

Approximate Submodular Functions and Performance Guarantees

We consider the problem of maximizing non-negative non-decreasing set fu...
03/08/2017

On Approximation Guarantees for Greedy Low Rank Optimization

We provide new approximation guarantees for greedy low rank matrix estim...
05/06/2020

Differentiable Greedy Submodular Maximization: Guarantees, Gradient Estimators, and Applications

We consider making outputs of the greedy algorithm for monotone submodul...
02/25/2016

Probably Approximately Correct Greedy Maximization

Submodular function maximization finds application in a variety of real-...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.