OPTION: OPTImization Algorithm Benchmarking ONtology

by   Ana Kostovska, et al.

Many platforms for benchmarking optimization algorithms offer users the possibility of sharing their experimental data with the purpose of promoting reproducible and reusable research. However, different platforms use different data models and formats, which drastically inhibits identification of relevant data sets, their interpretation, and their interoperability. Consequently, a semantically rich, ontology-based, machine-readable data model is highly desired. We report in this paper on the development of such an ontology, which we name OPTION (OPTImization algorithm benchmarking ONtology). Our ontology provides the vocabulary needed for semantic annotation of the core entities involved in the benchmarking process, such as algorithms, problems, and evaluation measures. It also provides means for automated data integration, improved interoperability, powerful querying capabilities and reasoning, thereby enriching the value of the benchmark data. We demonstrate the utility of OPTION by annotating and querying a corpus of benchmark performance data from the BBOB workshop data - a use case which can be easily extended to cover other benchmarking data collections.


page 1

page 2


Towards Large Scale Automated Algorithm Design by Integrating Modular Benchmarking Frameworks

We present a first proof-of-concept use-case that demonstrates the effic...

The OpenCitations Data Model

A variety of schemas and ontologies are currently used for the machine-r...

Olympus: a benchmarking framework for noisy optimization and experiment planning

Research challenges encountered across science, engineering, and economi...

OntoMath^PRO Ontology: A Linked Data Hub for Mathematics

In this paper, we present an ontology of mathematical knowledge concepts...

The CaLiGraph Ontology as a Challenge for OWL Reasoners

CaLiGraph is a large-scale cross-domain knowledge graph generated from W...

Towards a Modular Ontology for Space Weather Research

The interactions between the Sun, interplanetary space, near Earth space...

DARSI: An Ontology for Facilitating the Development of Data Sharing and Use Agreements

The advantages of data sharing across organizations and disciplines are ...