The Recomputation Manifesto

04/12/2013
by   Ian P. Gent, et al.
0

Replication of scientific experiments is critical to the advance of science. Unfortunately, the discipline of Computer Science has never treated replication seriously, even though computers are very good at doing the same thing over and over again. Not only are experiments rarely replicated, they are rarely even replicable in a meaningful way. Scientists are being encouraged to make their source code available, but this is only a small step. Even in the happy event that source code can be built and run successfully, running code is a long way away from being able to replicate the experiment that code was used for. I propose that the discipline of Computer Science must embrace replication of experiments as standard practice. I propose that the only credible technique to make experiments truly replicable is to provide copies of virtual machines in which the experiments are validated to run. I propose that tools and repositories should be made available to make this happen. I propose to be one of those who makes it happen.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/14/2017

Sustainable computational science: the ReScience initiative

Computer science offers a large set of tools for prototyping, writing, r...
research
03/12/2018

Replication study: Development and validation of deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs

We have replicated some experiments in 'Development and validation of a ...
research
05/25/2020

TeaMPI – Replication-based Resilience without the (Performance) Pain

In an era where we can not afford to checkpoint frequently, replication ...
research
02/08/2021

Academic Source Code Plagiarism Detection by Measuring Program Behavioural Similarity

Source code plagiarism is a long-standing issue in tertiary computer sci...
research
02/08/2021

Evaluating the robustness of source code plagiarism detection tools to pervasive plagiarism-hiding modifications

Source code plagiarism is a common occurrence in undergraduate computer ...
research
05/08/2020

Encouraging early mastery of computational concepts through play

Learning to code, and more broadly, learning about computer science is a...
research
10/19/2019

Introduction to Coresets: Accurate Coresets

A coreset (or core-set) of an input set is its small summation, such tha...

Please sign up or login with your details

Forgot password? Click here to reset