A Replicated Quantitative Analysis of Fault Distributions in Complex Software Systems
- 23 April 2007
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 33 (5), 273-286
- https://doi.org/10.1109/tse.2007.1005
Abstract
To contribute to the body of empirical research on fault distributions during development of complex software systems, a replication of a study of Fenton and Ohlsson is conducted. The hypotheses from the original study are investigated using data taken from an environment that differs in terms of system size, project duration, and programming language. We have investigated four sets of hypotheses on data from three successive telecommunications projects: 1) the Pareto principle, that is, a small number of modules contain a majority of the faults (in the replication, the Pareto principle is confirmed), 2) fault persistence between test phases (a high fault incidence in function testing is shown to imply the same in system testing, as well as prerelease versus postrelease fault incidence), 3) the relation between number of faults and lines of code (the size relation from the original study could be neither confirmed nor disproved in the replication), and 4) fault density similarities across test phases and projects (in the replication study, fault densities are confirmed to be similar across projects). Through this replication study, we have contributed to what is known on fault distributions, which seem to be stable across environments.Keywords
This publication has 27 references indexed in Scilit:
- A spiral process model for case studies on software quality monitoring—method and metricsSoftware Process: Improvement and Practice, 2007
- Replicating software engineering experiments: a poisoned chalice or the Holy GrailInformation and Software Technology, 2005
- Module size distribution and defect densityPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Preliminary Software Engineering Theory as Investigated by Published ExperimentsEmpirical Software Engineering, 2001
- Predicting fault incidence using software change historyIEEE Transactions on Software Engineering, 2000
- The Design of Replicated StudiesThe American Statistician, 1993
- The detection of fault-prone programsIEEE Transactions on Software Engineering, 1992
- An analysis of several software defect modelsIEEE Transactions on Software Engineering, 1988
- Software errors and complexity: an empirical investigation0Communications of the ACM, 1984
- Optimizing Preventive Service of Software ProductsIBM Journal of Research and Development, 1984