Evaluating the PCPT risk calculator in ten international biopsy cohorts: results from the Prostate Biopsy Collaborative Group
- 31 December 2011
- journal article
- research article
- Published by Springer Science and Business Media LLC in World Journal of Urology
- Vol. 30 (2), 181-187
- https://doi.org/10.1007/s00345-011-0818-5
Abstract
Objectives To evaluate the discrimination, calibration, and net benefit performance of the Prostate Cancer Prevention Trial Risk Calculator (PCPTRC) across five European randomized study of screening for prostate cancer (ERSPC), 1 United Kingdom, 1 Austrian, and 3 US biopsy cohorts. Methods PCPTRC risks were calculated for 25,733 biopsies using prostate-specific antigen (PSA), digital rectal examination, family history, history of prior biopsy, and imputation for missing covariates. Predictions were evaluated using the areas underneath the receiver operating characteristic curves (AUC), discrimination slopes, chi-square tests of goodness of fit, and net benefit decision curves. Results AUCs of the PCPTRC ranged from a low of 56% in the ERSPC Goeteborg Rounds 2–6 cohort to a high of 72% in the ERSPC Goeteborg Round 1 cohort and were statistically significantly higher than that of PSA in 6 out of the 10 cohorts. The PCPTRC was well calibrated in the SABOR, Tyrol, and Durham cohorts. There was limited to no net benefit to using the PCPTRC for biopsy referral compared to biopsying all or no men in all five ERSPC cohorts and benefit within a limited range of risk thresholds in all other cohorts. Conclusions External validation of the PCPTRC across ten cohorts revealed varying degree of success highly dependent on the cohort, most likely due to different criteria for and work-up before biopsy. Future validation studies of new calculators for prostate cancer should acknowledge the potential impact of the specific cohort studied when reporting successful versus failed validation.Keywords
This publication has 18 references indexed in Scilit:
- Everything You Always Wanted to Know About Evaluating Prediction Models (But Were Too Afraid to Ask)Urology, 2010
- Head‐to‐head comparison of two online nomograms for prostate biopsy outcome predictionBJU International, 2010
- The Relationship between Prostate-Specific Antigen and Prostate Cancer Risk: The Prostate Biopsy Collaborative GroupClinical Cancer Research, 2010
- Missing covariate data in medical research: To impute is better than to ignoreJournal of Clinical Epidemiology, 2010
- Performance of Prostate Cancer Prevention Trial Risk Calculator in a Contemporary Cohort Screened for Prostate Cancer and Diagnosed by Extended Prostate BiopsyJournal of Urology, 2010
- Predicting the outcome of prostate biopsy: comparison of a novel logistic regression‐based model, the prostate cancer risk calculator, and prostate‐specific antigen level aloneBJU International, 2009
- The Prostate Cancer Prevention Trial and European Randomized Study of Screening for Prostate Cancer risk calculators indicating a positive prostate biopsy: a comparisonBJU International, 2008
- Decision Curve Analysis: A Novel Method for Evaluating Prediction ModelsMedical Decision Making, 2006
- Assessing Prostate Cancer Risk: Results from the Prostate Cancer Prevention TrialJNCI Journal of the National Cancer Institute, 2006