Assessment of learning curves in complex surgical interventions: a consecutive case-series study
Open Access
- 1 June 2016
- journal article
- research article
- Published by Springer Science and Business Media LLC in Trials
- Vol. 17 (1), 1-10
- https://doi.org/10.1186/s13063-016-1383-4
Abstract
Surgical interventions are complex, which complicates their rigorous assessment through randomised clinical trials. An important component of complexity relates to surgeon experience and the rate at which the required level of skill is achieved, known as the learning curve. There is considerable evidence that operator performance for surgical innovations will change with increasing experience. Such learning effects complicate evaluations; the start of the trial might be delayed, resulting in loss of surgeon equipoise or, if an assessment is undertaken before performance has stabilised, the true impact of the intervention may be distorted. Formal estimation of learning parameters is necessary to characterise the learning curve, model its evolution and adjust for its presence during assessment. Current methods are either descriptive or model the learning curve through three main features: the initial skill level, the learning rate and the final skill level achieved. We introduce a fourth characterising feature, the duration of the learning period, which provides an estimate of the point at which learning has stabilised. We propose a two-phase model to estimate formally all four learning curve features. We demonstrate that the two-phase model can be used to estimate the end of the learning period by incorporating a parameter for estimating the duration of learning. This is achieved by breaking down the model into a phase describing the learning period and one describing cases after the final skill level is reached, with the break point representing the length of learning. We illustrate the method using cardiac surgery data. This modelling extension is useful as it provides a measure of the potential cost of learning an intervention and enables statisticians to accommodate cases undertaken during the learning phase and assess the intervention after the optimal skill level is reached. The limitations of the method and implications for the optimal timing of a definitive randomised controlled trial are also discussed.Keywords
Funding Information
- Gates Cambridge Trust (PhD Studentship)
- A.G. Leventis Foundation (Postgraduate studies Grant)
- Medical Research Council (PhD studentship)
This publication has 19 references indexed in Scilit:
- Measuring the surgical ‘learning curve’: methods, variables and competencyBJU International, 2013
- Robot‐assisted radical prostatectomy: learning rate analysis as an objective measure of the acquisition of surgical skillBJU International, 2010
- Randomized Controlled Trials of Surgical InterventionsAnnals of Surgery, 2010
- No surgical innovation without evaluation: the IDEAL recommendationsThe Lancet, 2009
- Challenges in evaluating surgical innovationThe Lancet, 2009
- The challenges faced in the design, conduct and analysis of surgical randomised controlled trialsTrials, 2009
- Statistical evaluation of learning curve effects in surgical trialsClinical Trials, 2004
- The Strategy-Specific Nature of Improvement: The Power Law Applies by Strategy Within TaskPsychological Science, 1998
- When Is the ‘right’ Time to Initiate an Assessment of a Health TechnologyInternational Journal of Technology Assessment in Health Care, 1998
- Evaluating new surgical proceduresBMJ, 1995