On the success of empirical studies in the international conference on software engineering
- 28 May 2006
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 341-350
- https://doi.org/10.1145/1134285.1134333
Abstract
Critiques of the quantity and quality of empirical evaluations in software engineering have existed for quite some time. However such critiques are typically not empirically evaluated. This paper fills this gap by empirically analyzing papers published by ICSE, the prime research conference on Software Engineering. We present quantitative and qualitative results of a quasi-random experiment of empirical evaluations over the lifetime of the conference. Our quantitative results show the quantity of empirical evaluation has increased over 29 ICSE proceedings but we still have room to improve the soundness of empirical evaluations in ICSE proceedings. Our qualitative results point to specific areas of improvement in empirical evaluations.This publication has 13 references indexed in Scilit:
- Soup or Art? The role of evidential force in empirical software engineeringIEEE Software, 2005
- The type of evidence produced by empirical software engineersPublished by Association for Computing Machinery (ACM) ,2005
- Experimental Validation of New Software TechnologyPublished by World Scientific Pub Co Pte Ltd ,2003
- Preliminary guidelines for empirical research in software engineeringIEEE Transactions on Software Engineering, 2002
- Basics of Software Engineering ExperimentationPublished by Springer Science and Business Media LLC ,2001
- Empirical studies of software engineeringPublished by Association for Computing Machinery (ACM) ,2000
- Building knowledge through families of experimentsIEEE Transactions on Software Engineering, 1999
- Should computer scientists experiment more?Computer, 1998
- Ten rules for reading clinical research reportsAmerican Journal of Orthodontics and Dentofacial Orthopedics, 1996
- Experimental evaluation in computer science: A quantitative studyJournal of Systems and Software, 1995