Restoring Execution Environments of Jupyter Notebooks

03/04/2021
by   Jiawei Wang, et al.
0

More than ninety percent of published Jupyter notebooks do not state dependencies on external packages. This makes them non-executable and thus hinders reproducibility of scientific results. We present SnifferDog, an approach that 1) collects the APIs of Python packages and versions, creating a database of APIs; 2) analyzes notebooks to determine candidates for required packages and versions; and 3) checks which packages are required to make the notebook executable (and ideally, reproduce its stored results). In its evaluation, we show that SnifferDog precisely restores execution environments for the largest majority of notebooks, making them immediately executable for end users.

READ FULL TEXT

page 3

page 7

page 8

page 9

research
08/24/2023

npm-follower: A Complete Dataset Tracking the NPM Ecosystem

Software developers typically rely upon a large network of dependencies ...
research
03/16/2021

A Quantitative Assessment of Package Freshness in Linux Distributions

Linux users expect fresh packages in the official repositories of their ...
research
03/31/2022

A Framework to capture and reproduce the Absolute State of Jupyter Notebooks

Jupyter Notebooks are an enormously popular tool for creating and narrat...
research
11/23/2022

: a Python "smuggler" for constructing lightweight reproducible notebooks

Reproducibility is a core requirement of modern scientific research. For...
research
06/05/2019

pCAMP: Performance Comparison of Machine Learning Packages on the Edges

Machine learning has changed the computing paradigm. Products today are ...
research
01/29/2020

The Rockerverse: Packages and Applications for Containerization with R

The Rocker Project provides widely-used Docker images for R across diffe...
research
05/20/2019

Custom Execution Environments with Containers in Pegasus-enabled Scientific Workflows

Science reproducibility is a cornerstone feature in scientific workflows...

Please sign up or login with your details

Forgot password? Click here to reset