Reliability of NI-RADS criteria in the interpretation of contrast-enhanced magnetic resonance imaging considering the potential role of diffusion-weighted imaging
Open Access
- 3 February 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in European Radiology
- Vol. 31 (8), 6295-6304
- https://doi.org/10.1007/s00330-021-07693-4
Abstract
Objectives: To assess inter- and intrareader agreement of the Neck Imaging Reporting and Data System (NI-RADS) used in contrast-enhanced magnetic resonance imaging (MRI) including analysis of diffusion-weighted imaging (DWI), which is currently not part of the NI-RADS criteria. Methods: This retrospective study included anonymized surveillance contrast-enhanced MRI datasets of 104 patients treated for different head and neck cancers. Three radiologists experienced in head and neck imaging reported findings for the primary site and the neck using NI-RADS criteria in a first step and evaluated DWI sequences for the primary site in a second step. Thirty randomly selected imaging datasets were again presented to the readers. Kappa statistics and observed agreement (Ao) were calculated. Results: Interreader agreement across all MRI datasets was moderate (κFleiss = 0.53) for NI-RADS categories assigned to the primary site, substantial for NI-RADS categories of the neck (κFleiss = 0.67), and almost perfect for DWI of the primary site (κFleiss = 0.83). Interreader agreement for the primary site was particularly low in cases of cancer recurrence (κFleiss = 0.35) and when categories 2a, 2b, and 3 were combined (κFleiss = 0.30). Intrareader agreement was considerably lower for NI-RADS categories of the primary site (range Ao = 53.3–70.0%) than for NI-RADS categories of the neck (range Ao = 83.3–90.0%) and DWI of the primary site (range Ao = 93.3–100.0%). Conclusion: Interreader agreement of NI-RADS for reporting contrast-enhanced MRI findings is acceptable for the neck but limited for the primary site. Here, DWI has the potential to serve as a reliable additional criterion. Key Points: • NI-RADS was originally designed for contrast-enhanced computed tomography with or without positron emission tomography but can also be used for contrast-enhanced magnetic resonance imaging alone. • Overall interreader agreement was acceptable for NI-RADS categories assigned to the neck but should be improved for the primary site, where it was inferior to DWI; similar tendencies were found for intrareader agreement. • DWI is currently no criterion of NI-RADS, but has shown potential to improve its reliability, especially for categories 2a, 2b, and 3 of the primary site.Funding Information
- Projekt DEAL
This publication has 24 references indexed in Scilit:
- Head and neck reconstructive surgery: what the radiologist needs to knowEuropean Radiology, 2016
- Implementation of a Novel Surveillance Template for Head and Neck Cancer: Neck Imaging Reporting and Data System (NI-RADS)Journal of the American College of Radiology, 2015
- Diagnostic Accuracy of Follow-Up FDG PET or PET/CT in Patients With Head and Neck Cancer After Definitive Treatment: A Systematic Review and Meta-AnalysisAmerican Journal of Roentgenology, 2015
- Reengineering the Radiology Enterprise: A Summary of the 2014 Intersociety Committee Summer ConferenceJournal of the American College of Radiology, 2015
- Impact of positron emission tomography/computed tomography surveillance at 12 and 24 months for detecting head and neck cancer recurrenceCancer, 2012
- New response evaluation criteria in solid tumours: Revised RECIST guideline (version 1.1)European Journal of Cancer, 2009
- Understanding interobserver agreement: the kappa statistic.2005
- Mammography interpretation: the BI-RADS method.1997
- High agreement but low Kappa: I. the problems of two paradoxesJournal of Clinical Epidemiology, 1990