An empirical study of regression testing techniques incorporating context and lifetime factors and improved cost-benefit models
- 5 November 2006
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 141-151
- https://doi.org/10.1145/1181775.1181793
Abstract
Regression testing is an important but expensive activity, and a great deal of research on regression testing methodologies has been performed. In recent years, much of this research has emphasized empirical studies, including evaluations of the effectiveness and efficiency of regression testing techniques. To date, however, most studies have been limited in terms of their consideration of testing context and system lifetime, and have used cost-benefit models that omit important factors and render some types of comparisons between techniques impossible. These limitations can cause studies to improperly assess the costs and benefits of regression testing techniques in practical settings. In this paper, we provide improved cost-benefit models for use in assessing regression testing methodologies, that incorporate context and lifetime factors not considered in prior studies, and we use these models to compare several common methodologies. Our results show that the factors we consider (in particular, time constraints and incremental resource availability) can affect assessments of the relative benefits of regression testing techniques, and suggest that particular classes of techniques may compare differently across different types of test suites.Keywords
This publication has 21 references indexed in Scilit:
- Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential ImpactEmpirical Software Engineering, 2005
- Selecting a Cost-Effective Test Case Prioritization TechniqueSoftware Quality Journal, 2004
- Test case prioritization: a family of empirical studiesIEEE Transactions on Software Engineering, 2002
- An empirical study of regression test selection techniquesACM Transactions on Software Engineering and Methodology, 2001
- A comparative study of coarse- and fine-grained safe regression test-selection techniquesACM Transactions on Software Engineering and Methodology, 2001
- Empirical studies of a prediction model for regression test selectionIEEE Transactions on Software Engineering, 2001
- Regression testing in an industrial environmentCommunications of the ACM, 1998
- A safe, efficient regression test selection techniqueACM Transactions on Software Engineering and Methodology, 1997
- Analyzing regression test selection techniquesIEEE Transactions on Software Engineering, 1996
- The category-partition method for specifying and generating fuctional testsCommunications of the ACM, 1988