On the evaluation of (meta-)solver approaches

02/17/2022
by   Roberto Amadini, et al.
0

Meta-solver approaches exploits a number of individual solvers to potentially build a better solver. To assess the performance of meta-solvers, one can simply adopt the metrics typically used for individual solvers (e.g., runtime or solution quality), or employ more specific evaluation metrics (e.g., by measuring how close the meta-solver gets to its virtual best performance). In this paper, based on some recently published works, we provide an overview of different performance metrics for evaluating (meta-)solvers, by underlying their strengths and weaknesses.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/07/2023

Automatic Algorithm Selection for Pseudo-Boolean Optimization with Given Computational Time Limits

Machine learning (ML) techniques have been proposed to automatically sel...
research
03/26/2018

Learning the Multiple Traveling Salesmen Problem with Permutation Invariant Pooling Networks

While there are optimal TSP solvers as well as recent learning-based app...
research
06/06/2020

Learning and Optimization of Blackbox Combinatorial Solvers in Neural Networks

The use of blackbox solvers inside neural networks is a relatively new a...
research
05/23/2023

Ties Matter: Modifying Kendall's Tau for Modern Metric Meta-Evaluation

Kendall's tau is frequently used to meta-evaluate how well machine trans...
research
03/28/2014

Difficulty Rating of Sudoku Puzzles: An Overview and Evaluation

How can we predict the difficulty of a Sudoku puzzle? We give an overvie...
research
01/31/2010

Constraint solvers: An empirical evaluation of design decisions

This paper presents an evaluation of the design decisions made in four s...
research
10/22/2022

torchode: A Parallel ODE Solver for PyTorch

We introduce an ODE solver for the PyTorch ecosystem that can solve mult...

Please sign up or login with your details

Forgot password? Click here to reset