Real-world Independent Testing of e-ASPECTS Software (RITeS): statistical analysis plan
Open Access
- 28 April 2020
- journal article
- Published by F1000 Research Ltd in AMRC Open Research
Abstract
Background: Artificial intelligence-based software may automatically detect ischaemic stroke lesions and provide an Alberta Stroke Program Early CT score (ASPECTS) on CT, and identify arterial occlusion and provide a collateral score on CTA. Large-scale independent testing will inform clinical use, but is lacking. We aim to test e-ASPECTS and e-CTA (Brainomix, Oxford UK) using CT scans obtained from a range of clinical studies. Methods: Using prospectively collected baseline CT and CTA scans from 10 national/international clinical stroke trials or registries (total >6600 patients), we will select a large clinically representative sample for testing e-ASPECTS and e-CTA compared to previously acquired independent expert human interpretation (reference standard). Our primary aims are to test agreement between software-derived and masked human expert ASPECTS, and the diagnostic accuracy of e-ASPECTS for identifying all causes of stroke symptoms using follow-up imaging and final clinical opinion as diagnostic ground truth. Our secondary aims are to test when and why e-ASPECTS is more or less accurate, or succeeds/fails to produce results, agreement between e-CTA and human expert CTA interpretation, and repeatability of e-ASPECTS/e-CTA results. All testing will be conducted on an intention-to-analyse basis. We will assess agreement between software and expert-human ratings and test the diagnostic accuracy of software. Conclusions: RITeS will provide comprehensive, robust and representative testing of e-ASPECTS and e-CTA against the current gold-standard, expert-human interpretation.Keywords
Funding Information
- The Stroke Association (TSA CR 2017/01)
- Medical Research Council (MC_PC_17188)
This publication has 48 references indexed in Scilit:
- Individual participant data meta-analyses should not ignore clusteringJournal of Clinical Epidemiology, 2013
- Protocol for the Perfusion and Angiography Imaging Sub-Study of the Third International Stroke Trial (IST-3) of Alteplase Treatment within Six-Hours of Acute Ischemic StrokeInternational Journal of Stroke, 2013
- The benefits and harms of intravenous thrombolysis with recombinant tissue plasminogen activator within 6 h of acute ischaemic stroke (the third international stroke trial [IST-3]): a randomised controlled trialThe Lancet, 2012
- A Large Web-Based Observer Reliability Study of Early Ischaemic Signs on Computed Tomography. The Acute Cerebral CT Evaluation of Stroke Study (ACCESS)PLOS ONE, 2010
- Understanding Equivalence and Noninferiority TestingJournal of General Internal Medicine, 2010
- The third international stroke trial (IST-3) of thrombolysis for acute ischaemic strokeTrials, 2008
- Statistical models for quantifying diagnostic accuracy with multiple lesions per patientBiostatistics, 2008
- Distinguishing Between Stroke and Mimic at the BedsideStroke, 2006
- A comparison of the Two One-Sided Tests Procedure and the Power Approach for assessing the equivalence of average bioavailabilityJournal of Pharmacokinetics and Biopharmaceutics, 1987
- STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENTThe Lancet, 1986