Relationships between Test Suites, Faults, and Fault Detection in GUI Testing
- 1 April 2008
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Software-testing researchers have long sought recipes for test suites that detect faults well. In the literature, empirical studies of testing techniques abound, yet the ideal technique for detecting the desired kinds of faults in a given situation often remains unclear. This work shows how understanding the context in which testing occurs, in terms of factors likely to influence fault detection, can make evaluations of testing techniques more readily applicable to new situations. We present a methodology for discovering which factors do statistically affect fault detection, and we perform an experiment with a set of test-suite- and fault-related factors in the GUI testing of two fielded, open-source applications. Statement coverage and GUI-event coverage are found to be statistically related to the likelihood of detecting certain kinds of faults.Keywords
This publication has 16 references indexed in Scilit:
- Faults' context mattersPublished by Association for Computing Machinery (ACM) ,2007
- Using GUI Run-Time State as Feedback to Generate Test Cases29th International Conference on Software Engineering (ICSE'07), 2007
- Studying the fault-detection effectiveness of GUI test cases for rapidly evolving softwareIEEE Transactions on Software Engineering, 2005
- Predicting the location and number of faults in large software systemsIEEE Transactions on Software Engineering, 2005
- On test suite composition and cost-effective regression testingACM Transactions on Software Engineering and Methodology, 2004
- Predicting fault detection effectivenessPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Understanding and measuring the sources of variation in the prioritization of regression test suitesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A semantic model of program faultsPublished by Association for Computing Machinery (ACM) ,1996
- An experimental determination of sufficient mutant operatorsACM Transactions on Software Engineering and Methodology, 1996
- Comparing the Effectiveness of Software Testing StrategiesIEEE Transactions on Software Engineering, 1987