Publishing computational research – A review of infrastructures for reproducible and transparent scholarly communication

by   Markus Konkol, et al.

The trend toward open science increases the pressure on authors to provide access to the source code and data they used to compute the results reported in their scientific papers. Since sharing materials reproducibly is challenging, several projects have developed solutions to support the release of executable analyses alongside articles. We reviewed 11 applications that can assist researchers in adhering to reproducibility principles. The applications were found through a literature search and interactions with the reproducible research community. An application was included in our analysis if it was actively maintained at the time the data for this paper was collected, supports the publication of executable code and data, is connected to the scholarly publication process. By investigating the software documentation and published articles, we compared the applications across 19 criteria, e.g. features that support authors in creating and readers in studying executable papers. From the 11 applications, eight allow publishers to self-host the system for free, whereas three provide paid services. Authors can submit an executable analysis using Jupyter Notebooks or R Markdown documents (10 applications support these formats). All approaches provide features to assist readers in studying the materials, e.g., one-click reproducible results or tools for manipulating the analysis parameters. Six applications allow for modifying materials after publication. The applications support authors to publish reproducible research predominantly with literate programming. Concerning readers, most applications provide user interfaces to inspect and manipulate the computational analysis.


page 1

page 2

page 3

page 4


Reproducible Research is more than Publishing Research Artefacts: A Systematic Analysis of Jupyter Notebooks from Research Articles

With the advent of Open Science, researchers have started to publish the...

Data objects and documenting scientific processes: An analysis of data events in biodiversity data papers

The data paper, an emerging scholarly genre, describes research datasets...

A Collaborative Approach to Computational Reproducibility

Although a standard in natural science, reproducibility has been only ep...

A continuous integration and web framework in support of the ATLAS Publication Process

The ATLAS collaboration defines methods, establishes procedures, and org...

Open Science and Authorship of Supplementary Material. Evidence from a Research Community

Authorship of scientific articles has profoundly changed from early scie...

On the Reliability of Funding Acknowledgements as Research Data: Evidence from Astronomy

Online bibliographic databases have enabled new research through which b...

Open-Pub: A Transparent yet Privacy-Preserving Academic Publication System based on Blockchain

Academic publications of latest research results are crucial to advance ...

Please sign up or login with your details

Forgot password? Click here to reset