Procrastinating with Confidence: Near-Optimal, Anytime, Adaptive Algorithm Configuration

02/14/2019
by   Robert Kleinberg, et al.
6

Algorithm configuration methods optimize the performance of a parameterized heuristic algorithm on a given distribution of problem instances. Recent work introduced an algorithm configuration procedure ('Structured Procrastination') that provably achieves near optimal performance with high probability and with nearly minimal runtime in the worst case. It also offers an anytime property: it keeps tightening its optimality guarantees the longer it is run. Unfortunately, Structured Procrastination is not adaptive to characteristics of the parameterized algorithm: it treats every input like the worst case. Follow-up work ('Leaps and Bounds') achieves adaptivity but trades away the anytime property. This paper introduces a new algorithm configuration method, 'Structured Procrastination with Confidence', that preserves the near-optimality and anytime properties of Structured Procrastination while adding adaptivity. In particular, the new algorithm will perform dramatically faster in settings where many algorithm configurations perform poorly; we show empirically that such settings arise frequently in practice.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

page 8

page 9

research
07/02/2018

LeapsAndBounds: A Method for Approximately Optimal Algorithm Configuration

We consider the problem of configuring general-purpose solvers to run ef...
research
11/22/2019

Worst case recovery guarantees for least squares approximation using random samples

We consider a least squares regression algorithm for the recovery of com...
research
04/14/2023

Optimal Uncoordinated Unique IDs

In the Uncoordinated Unique Identifiers Problem (UUIDP) there are n inde...
research
01/03/2013

Follow the Leader If You Can, Hedge If You Must

Follow-the-Leader (FTL) is an intuitive sequential prediction strategy t...
research
07/11/2019

On the Optimality of Trees Generated by ID3

Since its inception in the 1980s, ID3 has become one of the most success...
research
07/17/2017

An optimal unrestricted learning procedure

We study learning problems in the general setup, for arbitrary classes o...
research
06/18/2012

Near-Optimal BRL using Optimistic Local Transitions

Model-based Bayesian Reinforcement Learning (BRL) allows a found formali...

Please sign up or login with your details

Forgot password? Click here to reset