Run2Survive: A Decision-theoretic Approach to Algorithm Selection based on Survival Analysis

07/06/2020
by   Alexander Tornede, et al.
0

Algorithm selection (AS) deals with the automatic selection of an algorithm from a fixed set of candidate algorithms most suitable for a specific instance of an algorithmic problem class, where "suitability" often refers to an algorithm's runtime. Due to possibly extremely long runtimes of candidate algorithms, training data for algorithm selection models is usually generated under time constraints in the sense that not all algorithms are run to completion on all instances. Thus, training data usually comprises censored information, as the true runtime of algorithms timed out remains unknown. However, many standard AS approaches are not able to handle such information in a proper way. On the other side, survival analysis (SA) naturally supports censored data and offers appropriate ways to use such data for learning distributional models of algorithm runtime, as we demonstrate in this work. We leverage such models as a basis of a sophisticated decision-theoretic approach to algorithm selection, which we dub Run2Survive. Moreover, taking advantage of a framework of this kind, we advocate a risk-averse approach to algorithm selection, in which the avoidance of a timeout is given high priority. In an extensive experimental study with the standard benchmark ASlib, our approach is shown to be highly competitive and in many cases even superior to state-of-the-art AS approaches.

READ FULL TEXT
research
11/17/2020

Towards Meta-Algorithm Selection

Instance-specific algorithm selection (AS) deals with the automatic sele...
research
01/29/2020

Extreme Algorithm Selection With Dyadic Feature Representation

Algorithm selection (AS) deals with selecting an algorithm from a fixed ...
research
09/13/2021

Machine Learning for Online Algorithm Selection under Censored Feedback

In online algorithm selection (OAS), instances of an algorithmic problem...
research
07/20/2021

Algorithm Selection on a Meta Level

The problem of selecting an algorithm that appears most suitable for a s...
research
11/05/2012

Algorithm Runtime Prediction: Methods & Evaluation

Perhaps surprisingly, it is possible to predict how long an algorithm wi...
research
09/22/2017

Predicting Runtime Distributions using Deep Neural Networks

Many state-of-the-art algorithms for solving hard combinatorial problems...
research
12/24/2020

Generalization in portfolio-based algorithm selection

Portfolio-based algorithm selection has seen tremendous practical succes...

Please sign up or login with your details

Forgot password? Click here to reset