QBugs: A Collection of Reproducible Bugs in Quantum Algorithms and a Supporting Infrastructure to Enable Controlled Quantum Software Testing and Debugging Experiments

03/31/2021
by   José Campos, et al.
0

Reproducibility and comparability of empirical results are at the core tenet of the scientific method in any scientific field. To ease reproducibility of empirical studies, several benchmarks in software engineering research, such as Defects4J, have been developed and widely used. For quantum software engineering research, however, no benchmark has been established yet. In this position paper, we propose a new benchmark – named QBugs – which will provide experimental subjects and an experimental infrastructure to ease the evaluation of new research and the reproducibility of previously published results on quantum software engineering.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2022

Automated Quantum Software Engineering: why? what? how?

This article provides a personal perspective on research in Automated Qu...
research
03/02/2021

Stop Building Castles on a Swamp! The Crisis of Reproducing Automatic Search in Evidence-based Software Engineering

The evidence-based approach has increasingly been employed to synthesize...
research
01/28/2022

1-2-3 Reproducibility for Quantum Software Experiments

Various fields of science face a reproducibility crisis. For quantum sof...
research
10/24/2017

REPETITA: Repeatable Experiments for Performance Evaluation of Traffic-Engineering Algorithms

In this paper, we propose a pragmatic approach to improve reproducibilit...
research
06/20/2023

Fingerprinting and Building Large Reproducible Datasets

Obtaining a relevant dataset is central to conducting empirical studies ...
research
07/21/2023

Software engineering to sustain a high-performance computing scientific application: QMCPACK

We provide an overview of the software engineering efforts and their imp...
research
03/10/2022

Beyond the Badge: Reproducibility Engineering as a Lifetime Skill

Ascertaining reproducibility of scientific experiments is receiving incr...

Please sign up or login with your details

Forgot password? Click here to reset