Meeting in the notebook: a notebook-based environment for micro-submissions in data science collaborations

03/29/2021
by   Micah J. Smith, et al.
0

Developers in data science and other domains frequently use computational notebooks to create exploratory analyses and prototype models. However, they often struggle to incorporate existing software engineering tooling into these notebook-based workflows, leading to fragile development processes. We introduce Assemblé, a new development environment for collaborative data science projects, in which promising code fragments of data science pipelines can be contributed as pull requests to an upstream repository entirely from within JupyterLab, abstracting away low-level version control tool usage. We describe the design and implementation of Assemblé and report on a user study of 23 data scientists.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/14/2020

Enabling collaborative data science development with the Ballet framework

While the open-source model for software development has led to successf...
research
07/17/2020

A large-scale comparative analysis of Coding Standard conformance in Open-Source Data Science projects

Background: Meeting the growing industry demand for Data Science require...
research
01/13/2021

How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study

The development of AI applications is a multidisciplinary effort, involv...
research
09/06/2022

Deploying a sharded MongoDB cluster as a queued job on a shared HPC architecture

Data stores are the foundation on which data science, in all its variati...
research
04/30/2021

Lux: Always-on Visualization Recommendations for Exploratory Data Science

Exploratory data science largely happens in computational notebooks with...
research
03/08/2021

Leveraging Data Scientists and Business Expectations During the COVID-19 Pandemic

The COVID-19 pandemic presented itself as a challenge for separate socie...

Please sign up or login with your details

Forgot password? Click here to reset