Interexpert Agreement of Plus Disease Diagnosis in Retinopathy of Prematurity
Top Cited Papers
- 1 July 2007
- journal article
- research article
- Published by American Medical Association (AMA) in American Journal of Ophthalmology
- Vol. 125 (7), 875-880
- https://doi.org/10.1001/archopht.125.7.875
Abstract
Objective To measure agreement of plus disease diagnosis among retinopathy of prematurity (ROP) experts. Methods A set of 34 wide-angle retinal photographs from infants with ROP was compiled on a secure Web site and was interpreted independently by 22 recognized ROP experts. Diagnostic agreement was analyzed using 3-level (plus, pre-plus, or neither) and 2-level (plus or not plus) categorizations. Results In the 3-level categorization, all experts agreed on the same diagnosis in 4 of 34 images (12%), and the mean weighted κ statistic for each expert compared with all others was between 0.21 and 0.40 (fair agreement) for 7 experts (32%) and between 0.41 and 0.60 (moderate agreement) for 15 experts (68%). In the 2-level categorization, all experts who provided a diagnosis agreed in 7 of 34 images (21%), and the mean κ statistic for each expert compared with all others was between 0 and 0.20 (slight agreement) for 1 expert (5%), between 0.21 and 0.40 (fair agreement) for 3 experts (14%), between 0.41 and 0.60 (moderate agreement) for 12 experts (55%), and between 0.61 and 0.80 (substantial agreement) for 6 experts (27%). Conclusions Interexpert agreement of plus disease diagnosis is imperfect. This may have important implications for clinical ROP management, continued refinement of the international ROP classification system, development of computer-based diagnostic algorithms, and implementation of ROP telemedicine systems.Keywords
This publication has 12 references indexed in Scilit:
- Accuracy and Reliability of Remote Retinopathy of Prematurity DiagnosisAmerican Journal of Ophthalmology, 2006
- 15-Year Outcomes Following Threshold Retinopathy of Prematurity: Final Results From the Multicenter Trial of Cryotherapy for Retinopathy of PrematurityYearbook of Neonatal and Perinatal Medicine, 2006
- Diagnosis of plus disease in retinopathy of prematurity using Retinal Image multiScale Analysis.Investigative Ophthalmology & Visual Science, 2005
- Semiautomated computer analysis of vessel growth in preterm infants without and with ROPBritish Journal of Ophthalmology, 2003
- Blindness and visual impairment in the Americas and the CaribbeanBritish Journal of Ophthalmology, 2002
- Telephotoscreening to detect retinopathy of prematurity: Preliminary study of the optimum time to employ digital fundus camera imaging to detect ROPJournal of American Association for Pediatric Ophthalmology and Strabismus, 2002
- Prognostic significance of vascular dilation and tortuosity insufficient for plus disease in retinopathy of prematurityJournal of American Association for Pediatric Ophthalmology and Strabismus, 2000
- Evaluating evidence against diagnostic hypotheses in clinical decision making by students, residents and physiciansInternational Journal of Medical Informatics, 1998
- Evaluation Methods in Medical InformaticsPublished by Springer Science and Business Media LLC ,1997
- Systemic effects of screening for retinopathy of prematurity.British Journal of Ophthalmology, 1996