SwarmRob: A Toolkit for Reproducibility and Sharing of Experimental Artifacts in Robotics Research

01/12/2018
by   Aljoscha Pörtner, et al.
0

Due to the complexity of robotics, the reproducibility of results and experiments is one of the fundamental problems in robotics research. While the problem has been identified by the community, the approaches that address the problem appropriately are limited. The toolkit proposed in this paper tries to deal with the problem of reproducibility and sharing of experimental artifacts in robotics research by a holistic approach based on operating-system-level virtualization. The experimental artifacts of an experiment are isolated in "containers" that can be distributed to other researchers. Based on this, this paper presents a novel experimental workflow to describe, execute and distribute experimental software-artifacts to heterogeneous robots dynamically. As a result, the proposed solution supports researchers in executing and reproducing experimental evaluations.

READ FULL TEXT

page 1

page 5

research
08/24/2023

Laying foundations to quantify the "Effort of Reproducibility"

Why are some research studies easy to reproduce while others are difficu...
research
05/21/2023

Reproducibility Requires Consolidated Artifacts

Machine learning is facing a 'reproducibility crisis' where a significan...
research
01/07/2021

A review of robotics taxonomies in terms of form and structure

Identifying and categorizing specific robot tasks, behaviors, and resour...
research
04/29/2019

Challenges and Pitfalls of Reproducing Machine Learning Artifacts

An increasingly complex and diverse collection of Machine Learning(ML) m...
research
02/11/2020

Reproducibility Report for the Paper: Modeling of Request Cloning in Cloud Server Systems using Processor Sharing

The authors have uploaded their artifact on Zenodo, which ensures a long...
research
08/27/2022

The Ghost of Performance Reproducibility Past

The importance of ensemble computing is well established. However, execu...
research
08/10/2021

Quality Guidelines for Research Artifacts in Model-Driven Engineering

Sharing research artifacts is known to help people to build upon existin...

Please sign up or login with your details

Forgot password? Click here to reset