Automatic Detection of Public Development Projects in Large Open Source Ecosystems: An Exploratory Study on GitHub

by   Can Cheng, et al.

Hosting over 10 million of software projects, GitHub is one of the most important data sources to study behavior of developers and software projects. However, with the increase of the size of open source datasets, the potential threats to mining these datasets have also grown. As the dataset grows, it becomes gradually unrealistic for human to confirm quality of all samples. Some studies have investigated this problem and provided solutions to avoid threats in sample selection, but some of these solutions (e.g., finding development projects) require human intervention. When the amount of data to be processed increases, these semi-automatic solutions become less useful since the effort in need for human intervention is far beyond affordable. To solve this problem, we investigated the GHTorrent dataset and proposed a method to detect public development projects. The results show that our method can effectively improve the sample selection process in two ways: (1) We provide a simple model to automatically select samples (with 0.827 precision and 0.947 recall); (2) We also offer a complex model to help researchers carefully screen samples (with 63.2 precision and 0.959 recall).


page 1

page 2

page 3

page 4


A Dataset of Enterprise-Driven Open Source Software

We present a dataset of open source software developed mainly by enterpr...

PHANTOM: Curating GitHub for engineered software projects using time-series clustering

Context: Within the field of Mining Software Repositories, there are num...

Exploring Factors and Measures to Select Open Source Software

[Context] Open Source Software (OSS) is nowadays used and integrated in ...

Evaluating Heuristics for Iterative Impact Analysis

Iterative impact analysis (IIA) is a process that allows developers to e...

Do software firms collaborate or compete? A model of coopetition in community-initiated OSS projects

[Background] An increasing number of commercial firms are participating ...

Sampling Projects in GitHub for MSR Studies

Almost every Mining Software Repositories (MSR) study requires, as first...

Geographic Diversity in Public Code Contributions

We conduct an exploratory, large-scale, longitudinal study of 50 years o...