Inter-rater variability of visual interpretation and comparison with quantitative evaluation of 11C-PiB PET amyloid images of the Japanese Alzheimer’s Disease Neuroimaging Initiative (J-ADNI) multicenter study
- 13 December 2016
- journal article
- research article
- Published by Springer Science and Business Media LLC in European Journal of Nuclear Medicine and Molecular Imaging
- Vol. 44 (5), 850-857
- https://doi.org/10.1007/s00259-016-3591-2
Abstract
The aim of this study was to assess the inter-rater variability of the visual interpretation of 11C-PiB PET images regarding the positivity/negativity of amyloid deposition that were obtained in a multicenter clinical research project, Japanese Alzheimer’s Disease Neuroimaging Initiative (J-ADNI). The results of visual interpretation were also compared with a semi-automatic quantitative analysis using mean cortical standardized uptake value ratio to the cerebellar cortex (mcSUVR). A total of 162 11C-PiB PET scans, including 45 mild Alzheimer’s disease, 60 mild cognitive impairment, and 57 normal cognitive control cases that had been acquired as J-ADNI baseline scans were analyzed. Based on visual interpretation by three independent raters followed by consensus read, each case was classified into positive, equivocal, and negative deposition (ternary criteria) and further dichotomized by merging the former two (binary criteria). Complete agreement of visual interpretation by the three raters was observed for 91.3% of the cases (Cohen κ = 0.88 on average) in ternary criteria and for 92.3% (κ = 0.89) in binary criteria. Cases that were interpreted as visually positive in the consensus read showed significantly higher mcSUVR than those visually negative (2.21 ± 0.37 vs. 1.27 ± 0.09, p < 0.001), and positive or negative decision by visual interpretation was dichotomized by a cut-off value of mcSUVR = 1.5. Significant positive/negative associations were observed between mcSUVR and the number of raters who evaluated as positive (ρ = 0.87, p < 0.0001) and negative (ρ = −0.85, p < 0.0001) interpretation. Cases of disagreement among raters showed generally low mcSUVR. Inter-rater agreement was almost perfect in 11C-PiB PET scans. Positive or negative decision by visual interpretation was dichotomized by a cut-off value of mcSUVR = 1.5. As some cases of disagreement among raters tended to show low mcSUVR, referring to quantitative method may facilitate correct diagnosis when evaluating images of low amyloid deposition.Funding Information
- New Energy and Industrial Technology Development Organization
- Ministry of Health, Labour and Welfare
- J-ADNI Pharmaceutical Industry Scientific Advisory Board Companies
This publication has 31 references indexed in Scilit:
- Brain Amyloid Imaging — FDA Approval of Florbetapir F18 InjectionThe New England Journal of Medicine, 2012
- Amyloid vs FDG-PET in the differential diagnosis of AD and FTLDNeurology, 2011
- The amyloid cascade hypothesis for Alzheimer's disease: an appraisal for the development of therapeuticsNature Reviews Drug Discovery, 2011
- Inter-rater reliability of manual and automated region-of-interest delineation for PiB PETNeuroImage, 2011
- Molecular imaging in the diagnosis of Alzheimer's disease: visual assessment of [11C]PIB and [18F]FDDNP PET imagesJournal of Neurology, Neurosurgery & Psychiatry, 2010
- Hypothetical model of dynamic biomarkers of the Alzheimer's pathological cascadeThe Lancet Neurology, 2010
- Ethnic or Racial Differences RevisitedClinical Pharmacokinetics, 2006
- Imaging brain amyloid in Alzheimer's disease with Pittsburgh Compound‐BAnnals of Neurology, 2004
- Frequency of Stages of Alzheimer-Related Lesions in Different Age CategoriesNeurobiology of Aging, 1997
- Clinical diagnosis of Alzheimer's diseaseNeurology, 1984