The Impact of Sampling and Rule Set Size on Generated Fuzzy Inference System Predictive Accuracy: Analysis of a Software Engineering Data Set

by   Stephen G. MacDonell, et al.

Software project management makes extensive use of predictive modeling to estimate product size, defect proneness and development effort. Although uncertainty is acknowledged in these tasks, fuzzy inference systems, designed to cope well with uncertainty, have received only limited attention in the software engineering domain. In this study we empirically investigate the impact of two choices on the predictive accuracy of generated fuzzy inference systems when applied to a software engineering data set: sampling of observations for training and testing; and the size of the rule set generated using fuzzy c-means clustering. Over ten samples we found no consistent pattern of predictive performance given certain rule set size. We did find, however, that a rule set compiled from multiple samples generally resulted in more accurate predictions than single sample rule sets. More generally, the results provide further evidence of the sensitivity of empirical analysis outcomes to specific model-building decisions.


The Dangerous Dogmas of Software Engineering

To legitimize itself as a scientific discipline, the software engineerin...

The Evolution of Empirical Methods in Software Engineering

Empirical methods like experimentation have become a powerful means to d...

Dealing with uncertainty in fuzzy inductive reasoning methodology

The aim of this research is to develop a reasoning under uncertainty str...

Summarising Big Data: Common GitHub Dataset for Software Engineering Challenges

In open-source software development environments; textual, numerical and...

Sampling in Software Engineering Research: A Critical Review and Guidelines

Representative sampling appears rare in software engineering research. N...

ComSum: Commit Messages Summarization and Meaning Preservation

We present ComSum, a data set of 7 million commit messages for text summ...

Assert Use and Defectiveness in Industrial Code

The use of asserts in code has received increasing attention in the soft...