Bayes DistNet – A Robust Neural Network for Algorithm Runtime Distribution Predictions

12/14/2020
by   Jake Tuero, et al.
0

Randomized algorithms are used in many state-of-the-art solvers for constraint satisfaction problems (CSP) and Boolean satisfiability (SAT) problems. For many of these problems, there is no single solver which will dominate others. Having access to the underlying runtime distributions (RTD) of these solvers can allow for better use of algorithm selection, algorithm portfolios, and restart strategies. Previous state-of-the-art methods directly try to predict a fixed parametric distribution that the input instance follows. In this paper, we extend RTD prediction models into the Bayesian setting for the first time. This new model achieves robust predictive performance in the low observation setting, as well as handling censored observations. This technique also allows for richer representations which cannot be achieved by the classical models which restrict their output representations. Our model outperforms the previous state-of-the-art model in settings in which data is scarce, and can make use of censored data such as lower bound time estimates, where that type of data would otherwise be discarded. It can also quantify its uncertainty in its predictions, allowing for algorithm portfolio models to make better informed decisions about which algorithm to run on a particular instance.

READ FULL TEXT

page 6

page 7

research
09/22/2017

Predicting Runtime Distributions using Deep Neural Networks

Many state-of-the-art algorithms for solving hard combinatorial problems...
research
03/05/2019

PDP: A General Neural Framework for Learning Constraint Satisfaction Solvers

There have been recent efforts for incorporating Graph Neural Network mo...
research
11/05/2012

Algorithm Runtime Prediction: Methods & Evaluation

Perhaps surprisingly, it is possible to predict how long an algorithm wi...
research
03/12/2019

NeuroCore: Guiding High-Performance SAT Solvers with Unsat-Core Predictions

The NeuroSAT neural network architecture was introduced for predicting p...
research
03/12/2019

Guiding High-Performance SAT Solvers with Unsat-Core Predictions

The NeuroSAT neural network architecture was recently introduced for pre...
research
07/04/2021

Calibrating generalized predictive distributions

In prediction problems, it is common to model the data-generating proces...
research
03/12/2019

NeuroCore: Guiding CDCL with Unsat-Core Predictions

The NeuroSAT neural network architecture was recently introduced for pre...

Please sign up or login with your details

Forgot password? Click here to reset