Stability of response characteristics of a Delphi panel: application of bootstrap data expansion
Top Cited Papers
Open Access
- 1 December 2005
- journal article
- research article
- Published by Springer Science and Business Media LLC in BMC Medical Research Methodology
- Vol. 5 (1), 37
- https://doi.org/10.1186/1471-2288-5-37
Abstract
Delphi surveys with panels of experts in a particular area of interest have been widely utilized in the fields of clinical medicine, nursing practice, medical education and healthcare services. Despite this wide applicability of the Delphi methodology, there is no clear identification of what constitutes a sufficient number of Delphi survey participants to ensure stability of results. The study analyzed the response characteristics from the first round of a Delphi survey conducted with 23 experts in healthcare quality and patient safety. The panel members had similar training and subject matter understanding of the Malcolm Baldrige Criteria for Performance Excellence in Healthcare. The raw data from the first round sampling, which usually contains the largest diversity of responses, were augmented via bootstrap sampling to obtain computer-generated results for two larger samples obtained by sampling with replacement. Response characteristics (mean, trimmed mean, standard deviation and 95% confidence intervals) for 54 survey items were compared for the responses of the 23 actual study participants and two computer-generated samples of 1000 and 2000 resampling iterations. The results from this study indicate that the response characteristics of a small expert panel in a well-defined knowledge area are stable in light of augmented sampling. Panels of similarly trained experts (who possess a general understanding in the field of interest) provide effective and reliable utilization of a small sample from a limited number of experts in a field of study to develop reliable criteria that inform judgment and support effective decision-making.Keywords
This publication has 37 references indexed in Scilit:
- The effect of scientific misconduct on the results of clinical trials: A Delphi surveyContemporary Clinical Trials, 2005
- Evaluating Disease Management Program EffectivenessDisease Management and Health Outcomes, 2005
- Molecular Investigation of Two Possible Cases of Accidental HIV-1 Transmission in South AfricaAIDS Research and Human Retroviruses, 2003
- Delphi survey of experts’ opinions on strategies used by community pharmacists to reduce over‐the‐counter drug misuseAddiction, 2003
- Economic Comparison of Leflunomide and Methotrexate in Patients with Rheumatoid ArthritisPharmacoEconomics, 2002
- Cost-effectiveness of the addition of early hormonal therapy in locally advanced prostate cancer: results decisively determined by the cut-off time-point chosen for the analysisEuropean Journal of Cancer, 2001
- Iatrogenic Cost Factors Incorporating Mild and Moderate Adverse Events in the Economic Comparison of Aceclofenac and Other NSAIDsPharmacoEconomics, 2001
- Research guidelines for the Delphi survey techniqueJournal of Advanced Nursing, 2000
- A nonparametric procedure associated with a clinically meaningful efficacy measureBiostatistics, 2000
- The Delphi technique: a methodological discussionJournal of Advanced Nursing, 1994