A Theoretical and Empirical Study of Search-Based Testing: Local, Global, and Hybrid Search
Top Cited Papers
- 1 December 2009
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 36 (2), 226-247
- https://doi.org/10.1109/tse.2009.71
Abstract
Search-based optimization techniques have been applied to structural software test data generation since 1992, with a recent upsurge in interest and activity within this area. However, despite the large number of recent studies on the applicability of different search-based optimization approaches, there has been very little theoretical analysis of the types of testing problem for which these techniques are well suited. There are also few empirical studies that present results for larger programs. This paper presents a theoretical exploration of the most widely studied approach, the global search technique embodied by Genetic Algorithms. It also presents results from a large empirical study that compares the behavior of both global and local search-based optimization on real-world programs. The results of this study reveal that cases exist of test data generation problem that suit each algorithm, thereby suggesting that a hybrid global-local search (a Memetic Algorithm) may be appropriate. The paper presents a Memetic Algorithm along with further empirical results studying its performance.Keywords
This publication has 45 references indexed in Scilit:
- Empirical evaluation of a nesting testability transformation for evolutionary testingACM Transactions on Software Engineering and Methodology, 2009
- Empirical evaluation of optimization algorithms when used in goal-oriented automated test data generation techniquesEmpirical Software Engineering, 2006
- Evolutionary Testing Using an Extended Chaining ApproachEvolutionary Computation, 2006
- Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential ImpactEmpirical Software Engineering, 2005
- Search‐based software test data generation: a surveySoftware Testing, Verification and Reliability, 2004
- A validation of the component-based method for software size estimationIEEE Transactions on Software Engineering, 2000
- Automated test-data generation for exception conditionsSoftware: Practice and Experience, 2000
- The chaining approach for software test data generationACM Transactions on Software Engineering and Methodology, 1996
- Dynamic method for software test data generationSoftware Testing, Verification and Reliability, 1992
- Automated software test data generationIEEE Transactions on Software Engineering, 1990