Multi-Round compared to Real-Time Delphi for consensus in core outcome set (COS) development: a randomised trial
Open Access
- 15 February 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in Trials
- Vol. 22 (1), 1-9
- https://doi.org/10.1186/s13063-021-05074-2
Abstract
The Delphi method is used in a wide variety of settings as a method of building consensus on important issues. Traditionally, the Delphi method uses multiple rounds of a survey to allow for feedback of other participants’ survey responses in between rounds. By informing participants about how others answer a question or prioritise specific topics, it allows for diverse opinions to inform the consensus process. For this reason, the Delphi method is popular as a consensus building approach in developing core outcome sets (COS), i.e. the minimum agreed set of standardised outcomes that should be measured and reported in studies on a specific health condition. In a COS setting, participants prioritise the importance of outcomes for inclusion in a COS. This usually involves participating in multiple rounds of a survey that can span several weeks or months. Challenges with participant retention have been highlighted in previous COS. We will compare a three-round with a Real-Time Delphi approach on prioritised outcomes. This trial is embedded within the COHESION study which is developing a COS for interventions treating neonatal encephalopathy. One hundred and eighty stakeholders (parents/caregivers of infants diagnosed and treated with neonatal encephalopathy, healthcare providers and researchers) will be randomised using stratified randomisation to take part in either the Multi-Round or Real-Time Delphi. Stakeholders will rate the importance of the same set of outcomes in both arms. We will compare the prioritised outcomes at the end of both surveys as well as other parameters such as feedback, initial condition and iteration effects. This trial will provide evidence to inform decisions on the use of Multi-Round compared to Real-Time Delphi survey methods. NCT04471103. Registered on 14 July 2020.Funding Information
- Health Research Board (HRB-NEPTuNE)
This publication has 12 references indexed in Scilit:
- Recruiting and retaining participants in e-Delphi surveys for core outcome set development: Evaluating the COMiT'ID studyPLOS ONE, 2018
- The COMET Handbook: version 1.0Trials, 2017
- SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical TrialsAnnals of Internal Medicine, 2013
- Validating an innovative real-time Delphi approach - A methodological comparison between real-time and conventional Delphi studiesTechnological Forecasting and Social Change, 2011
- Using the Delphi Technique to Determine Which Outcomes to Measure in Clinical Trials: Recommendations for the Future Based on a Systematic Review of Existing StudiesPLoS Medicine, 2011
- Using the Delphi method to engage stakeholders: A comparison of two studiesEvaluation and Program Planning, 2010
- RT Delphi: An efficient, “round-less” almost real time Delphi methodTechnological Forecasting and Social Change, 2006
- Delphi: A reevaluation of research and theoryTechnological Forecasting and Social Change, 1991
- The design of a policy DelphiTechnological Forecasting and Social Change, 1970
- An Experimental Application of the DELPHI Method to the Use of ExpertsManagement Science, 1963