Concept and benchmarks for assessing narrow‐sense validity of genetic risk score values
- 29 April 2019
- journal article
- research article
- Published by Wiley in The Prostate
- Vol. 79 (10), 1099-1105
- https://doi.org/10.1002/pros.23821
Abstract
Background While higher genetic risk score (GRS) has been statistically associated with increased disease risk (broad‐sense validity), the concept and tools for assessing the validity of reported GRS values from tests (narrow‐sense validity) are underdeveloped. Methods We propose two benchmarks for assessing the narrow‐sense validity of GRS. The baseline benchmark requires that the mean GRS value in a general population approximates 1.0. The calibration benchmark assesses the agreement between observed risks and estimated risks (GRS values). We assessed benchmark performance for three prostate cancer (PCa) GRS tests, derived from three SNP panels with increasing stringency of selection criteria, in a PCa chemoprevention trial where 714 of 3225 men were diagnosed with PCa during the 4‐year follow‐up. Results GRS from Panels 1, 2, and 3 were all statistically associated with PCa risk; P = 5.58 × 10−3, P = 1 × 10−3, and P = 1.5 × 10−13, respectively (broad‐sense validity). For narrow‐sense validity, the mean GRS value among men without PCa was 1.33, 1.09, and 0.98 for Panels 1, 2, and 3, respectively (baseline benchmark). For assessing the calibration benchmark, observed risks were calculated for seven groups of men with GRS values <0.3, 0.3–0.79, 0.8–1.19, 1.2‐1.49, 1.5‐1.99, 2‐2.99, and ≥3. The calibration slope (higher is better) was 0.15, 0.12, and 0.60, and the bias score (lower is better) between the observed risks and GRS values was 0.08, 0.08, and 0.02 for Panels 1, 2, and 3, respectively. Conclusion Performance differed considerably among GRS tests. We recommend that all GRS tests be evaluated using the two benchmarks before clinical implementation for individual risk assessment.Keywords
Funding Information
- Ellrodt-Schweighauser, Chez and Melman families
This publication has 39 references indexed in Scilit:
- Novel Common Genetic Susceptibility Loci for Colorectal CancerJNCI Journal of the National Cancer Institute, 2018
- Association analyses of more than 140,000 men identify 63 new prostate cancer susceptibility lociNature Genetics, 2018
- Genome-wide association studies of cancer: current insights and future perspectivesNature Reviews Cancer, 2017
- Genetic Risk, Adherence to a Healthy Lifestyle, and Coronary DiseaseThe New England Journal of Medicine, 2016
- Adding genetic risk score to family history identifies twice as many high-risk men for prostate cancer: Results from the prostate cancer prevention trialThe Prostate, 2016
- Population-standardized genetic risk score: the SNP-based method of choice for inherited risk assessment of prostate cancerAsian Journal of Andrology, 2016
- A Large Multiethnic Genome-Wide Association Study of Prostate Cancer Identifies Novel Risk Variants and Substantial Ethnic DifferencesCancer Discovery, 2015
- Prediction of Breast Cancer Risk Based on Profiling With Common Genetic VariantsJNCI Journal of the National Cancer Institute, 2015
- Potential Impact of Adding Genetic Markers to Clinical Parameters in Predicting Prostate Biopsy Outcomes in Men Following an Initial Negative Biopsy: Findings from the REDUCE TrialEuropean Urology, 2012
- Cumulative Association of Five Genetic Variants with Prostate CancerThe New England Journal of Medicine, 2008