Online Continuous Submodular Maximization: From Full-Information to Bandit Feedback

10/28/2019
by   Mingrui Zhang, et al.
16

In this paper, we propose three online algorithms for submodular maximisation. The first one, Mono-Frank-Wolfe, reduces the number of per-function gradient evaluations from T^1/2 [Chen2018Online] and T^3/2 [chen2018projection] to 1, and achieves a (1-1/e)-regret bound of O(T^4/5). The second one, Bandit-Frank-Wolfe, is the first bandit algorithm for continuous DR-submodular maximization, which achieves a (1-1/e)-regret bound of O(T^8/9). Finally, we extend Bandit-Frank-Wolfe to a bandit algorithm for discrete submodular maximization, Responsive-Frank-Wolfe, which attains a (1-1/e)-regret bound of O(T^8/9) in the responsive bandit setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2022

Online Learning for Non-monotone Submodular Maximization: From Full Information to Bandit Feedback

In this paper, we revisit the online non-monotone continuous DR-submodul...
research
05/21/2023

Bandit Multi-linear DR-Submodular Maximization and Its Applications on Adversarial Submodular Bandits

We investigate the online bandit learning of the monotone multi-linear D...
research
07/13/2018

No-regret algorithms for online k-submodular maximization

We present a polynomial time algorithm for online maximization of k-subm...
research
09/08/2023

Online Submodular Maximization via Online Convex Optimization

We study monotone submodular maximization under general matroid constrai...
research
05/15/2022

Online Nonsubmodular Minimization with Delayed Costs: From Full Information to Bandit Feedback

Motivated by applications to online learning in sparse estimation and Ba...
research
06/01/2020

Submodular Bandit Problem Under Multiple Constraints

The linear submodular bandit problem was proposed to simultaneously addr...
research
07/07/2022

Interactive Combinatorial Bandits: Balancing Competitivity and Complementarity

We study non-modular function maximization in the online interactive ban...

Please sign up or login with your details

Forgot password? Click here to reset