Intraobserver and interobserver variability in computed tomography size and attenuation measurements in patients with renal cell carcinoma receiving antiangiogenic therapy: Implications for alternative response criteria
Open Access
- 21 November 2013
- Vol. 120 (5), 711-721
- https://doi.org/10.1002/cncr.28493
Abstract
BACKGROUND Alternative response criteria have been proposed in patients with metastatic renal cell carcinoma (mRCC) who are receiving vascular endothelial growth factor (VEGF)-targeted therapy, including 10% tumor shrinkage as an indicator of response/outcome. However, to the authors' knowledge, intraobserver and interobserver measurement variability have not been defined in this setting. The objective of the current study was to determine intraobserver and interobserver agreement of computed tomography (CT) size and attenuation measurements to establish reproducible response indicators. METHODS Seventy-one patients with mRCC with 179 target lesions were enrolled in phase 2 and phase 3 trials of VEGF-targeted therapies and retrospectively studied with Institutional Review Board approval. Two radiologists independently measured the long axis diameter and mean attenuation of target lesions at baseline and on follow-up CT. Concordance correlation coefficients and Bland-Altman plots were used to assess intraobserver and interobserver agreement. RESULTS High concordance correlation coefficients (range, 0.8602-0.9984) were observed in all types of measurements. The 95% limits of agreement for the percentage change of the sum longest diameter was −7.30% to 7.86% for intraobserver variability, indicating that 10% tumor shrinkage represents a true change in tumor size when measured by a single observer. The 95% limits of interobserver variability were −16.3% to 15.4%. On multivariate analysis, the location of the lesion was found to significantly contribute to interobserver variability (P = .048). The 95% limits of intraobserver agreement for the percentage change in CT attenuation were −18.34% to 16.7%. CONCLUSIONS In patients with mRCC who are treated with VEGF inhibitors, 10% tumor shrinkage is a reproducible radiologic response indicator when baseline and follow-up studies are measured by a single radiologist. Lesion location contributes significantly to measurement variability and should be considered when selecting target lesions. Cancer 2014;120:711–721. © 2013 American Cancer Society.Keywords
Funding Information
- General Electric
- Association of University Radiologists
This publication has 35 references indexed in Scilit:
- Pazopanib versus Sunitinib in Metastatic Renal-Cell CarcinomaNew England Journal of Medicine, 2013
- Variability of Lung Tumor Measurements on Repeat Computed Tomography Scans Taken Within 15 MinutesJournal of Clinical Oncology, 2011
- CT Tumor Volume Measurement in Advanced Non-small-cell Lung Cancer: Performance Characteristics of an Emerging Clinical ToolAcademic Radiology, 2011
- Choi response criteria for early prediction of clinical outcome in patients with metastatic renal cell cancer treated with sunitinibBritish Journal of Cancer, 2010
- Evaluating Variability in Tumor Measurements from Same-day Repeat CT Scans of Patients with Non–Small Cell Lung CancerRadiology, 2009
- New response evaluation criteria in solid tumours: Revised RECIST guideline (version 1.1)European Journal Of Cancer, 2009
- Sorafenib in Advanced Clear-Cell Renal-Cell CarcinomaNew England Journal of Medicine, 2007
- New Guidelines to Evaluate the Response to Treatment in Solid TumorsJNCI Journal of the National Cancer Institute, 2000
- STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENTThe Lancet, 1986
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960