High Probability Bounds for Stochastic Continuous Submodular Maximization

03/20/2023
by   Evan Becker, et al.
0

We consider maximization of stochastic monotone continuous submodular functions (CSF) with a diminishing return property. Existing algorithms only guarantee the performance in expectation, and do not bound the probability of getting a bad solution. This implies that for a particular run of the algorithms, the solution may be much worse than the provided guarantee in expectation. In this paper, we first empirically verify that this is indeed the case. Then, we provide the first high-probability analysis of the existing methods for stochastic CSF maximization, namely PGA, boosted PGA, SCG, and SCG++. Finally, we provide an improved high-probability bound for SCG, under slightly stronger assumptions, with a better convergence rate than that of the expected solution. Through extensive experiments on non-concave quadratic programming (NQP) and optimal budget allocation, we confirm the validity of our bounds and show that even in the worst-case, PGA converges to OPT/2, and boosted PGA, SCG, SCG++ converge to (1 - 1/e)OPT, but at a slower rate than that of the expected solution.

READ FULL TEXT
research
06/15/2021

Improved Regret Bounds for Online Submodular Maximization

In this paper, we consider an online optimization problem over T rounds ...
research
10/25/2018

A Deamortization Approach for Dynamic Spanner and Dynamic Maximal Matching

Many dynamic graph algorithms have an amortized update time, rather than...
research
08/17/2019

Approximation Guarantees of Stochastic Greedy Algorithms for Non-monotone Submodular Maximization with a Size Constraint

The stochastic greedy algorithm (SG) is a randomized version of the gree...
research
11/15/2021

Faster First-Order Algorithms for Monotone Strongly DR-Submodular Maximization

Continuous DR-submodular functions are a class of generally non-convex/n...
research
10/03/2022

High Probability Convergence for Accelerated Stochastic Mirror Descent

In this work, we describe a generic approach to show convergence with hi...
research
10/20/2020

Very Fast Streaming Submodular Function Maximization

Data summarization has become a valuable tool in understanding even tera...
research
12/19/2022

The One-Inclusion Graph Algorithm is not Always Optimal

The one-inclusion graph algorithm of Haussler, Littlestone, and Warmuth ...

Please sign up or login with your details

Forgot password? Click here to reset