Use of the ISUP e-learning module improves interrater reliability in prostate cancer grading
- 3 November 2022
- journal article
- research article
- Published by BMJ in Journal of Clinical Pathology
- Vol. 77 (1), 22-26
- https://doi.org/10.1136/jcp-2022-208506
Abstract
Aims Prostate cancer (PCa) grading is an important prognostic parameter, but is subject to considerable observer variation. Previous studies have shown that interobserver variability decreases after participants were trained using an e-learning module. However, since the publication of these studies, grading of PCa has been enhanced by adopting the International Society of Urological Pathology (ISUP) 2014 grading classification. This study investigates the effect of training on interobserver variability of PCa grading, using the ISUP Education web e-learning on Gleason grading. Methods The ISUP Education Prostate Test B Module was distributed among Dutch pathologists. The module uses images graded by the ISUP consensus panel consisting of 24 expert uropathologists. Participants graded the same 10 images before and after e-learning. We included those who completed the tests before and after training. We evaluated variation in PCa grading in a fully crossed study design, using linearly weighted kappa values for each pathologist, comparing them to other pathologists and to the ISUP consensus panel. We analysed the improvement in median weighted kappas before and after training, using Wilcoxon’s signed rank-test. Results We included 42 pathologists. Inter-rater reliability between pathologists improved from 0.70 before training to 0.74 after training (p=0.01). When compared with the ISUP consensus panel, five pathologists improved significantly, whereas the kappa of one pathologist was significantly lower after training. All pathologists who improved significantly, graded with less than substantial agreement before training. Conclusions ISUP Prostate Test B e-learning reduces variability in PCa grading. E-learning is a cost-effective method for standardisation of pathology.Keywords
This publication has 35 references indexed in Scilit:
- The 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic CarcinomaThe American Journal of Surgical Pathology, 2016
- A Contemporary Prostate Cancer Grading System: A Validated Alternative to the Gleason ScoreEuropean Urology, 2015
- The reasons behind variation in Gleason grading of prostatic biopsies: areas of agreement and misconception among 266 European pathologistsHistopathology, 2013
- Standardization of Gleason grading among 337 European pathologistsHistopathology, 2012
- Computing Inter-Rater Reliability for Observational Data: An Overview and TutorialTutorials in Quantitative Methods for Psychology, 2012
- Gleason scoring of prostatic carcinoma: Impact of a web-based tutorial on inter- and intra-observer variabilityIndian Journal of Pathology and Microbiology, 2008
- Interobserver reproducibility of Gleason grading of prostatic carcinoma: General pathologistHuman Pathology, 2001
- Interobserver reproducibility of Gleason grading of prostatic carcinoma: Urologic pathologistsHuman Pathology, 2001
- General Observer-Agreement Measures on Individual Subjects and Groups of SubjectsBiometrics, 1984
- Measuring pairwise interobserver agreement when all subjects are judged by the same observersStatistica Neerlandica, 1982