The influence of size and coverage on test suite effectiveness
- 19 July 2009
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
We study the relationship between three properties of test suites: size, structural coverage, and fault-finding effectiveness. In particular, we study the question of whether achieving high coverage leads directly to greater effectiveness, or only indirectly through forcing a test suite to be larger. Our experiments indicate that coverage is sometimes correlated with effectiveness when size is controlled for, and that using both size and coverage yields a more accurate prediction of effectiveness than size alone. This in turn suggests that both size and coverage are important to test suite effectiveness. Our experiments also indicate that no linear relationship exists among the three variables of size, coverage and effectiveness, but that a nonlinear relationship does exist.Keywords
This publication has 7 references indexed in Scilit:
- Sufficient mutation operators for measuring test effectivenessPublished by Association for Computing Machinery (ACM) ,2008
- Using Mutation Analysis for Assessing and Comparing Testing Coverage CriteriaIEEE Transactions on Software Engineering, 2006
- Is mutation an appropriate tool for testing experiments?Published by Association for Computing Machinery (ACM) ,2005
- A data flow coverage testing tool for CPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Empirical studies of test‐suite reductionSoftware Testing, Verification and Reliability, 2002
- Further empirical studies of test effectivenessPublished by Association for Computing Machinery (ACM) ,1998
- An experimental comparison of the effectiveness of branch testing and data flow testingIEEE Transactions on Software Engineering, 1993