A methodological framework to distinguish spectrum effects from spectrum biases and to assess diagnostic and screening test accuracy for patient populations: Application to the Papanicolaou cervical cancer smear test
Open Access
- 21 February 2008
- journal article
- Published by Springer Science and Business Media LLC in BMC Medical Research Methodology
- Vol. 8 (1), 7
- https://doi.org/10.1186/1471-2288-8-7
Abstract
Background A spectrum effect was defined as differences in the sensitivity or specificity of a diagnostic test according to the patient's characteristics or disease features. A spectrum effect can lead to a spectrum bias when subgroup variations in sensitivity or specificity also affect the likelihood ratios and thus post-test probabilities. We propose and illustrate a methodological framework to distinguish spectrum effects from spectrum biases. Methods Data were collected for 1781 women having had a cervical smear test and colposcopy followed by biopsy if abnormalities were detected (the reference standard). Logistic models were constructed to evaluate both the sensitivity and specificity, and the likelihood ratios, of the test and to identify factors independently affecting the test's characteristics. Results For both tests, human papillomavirus test, study setting and age affected sensitivity or specificity of the smear test (spectrum effect), but only human papillomavirus test and study setting modified the likelihood ratios (spectrum bias) for clinical reading, whereas only human papillomavirus test and age modified the likelihood ratios (spectrum bias) for "optimized" interpretation. Conclusion Fitting sensitivity, specificity and likelihood ratios simultaneously allows the identification of covariates that independently affect diagnostic or screening test results and distinguishes spectrum effect from spectrum bias. We recommend this approach for the development of new tests, and for reporting test accuracy for different patient populations.Keywords
This publication has 49 references indexed in Scilit:
- Use of Progressive Glaucomatous Optic Disk Change as the Reference Standard for Evaluation of Diagnostic Tests in GlaucomaAmerican Journal of Ophthalmology, 2005
- Efficiency of the Hybrid Capture 2 HPV DNA Test in Cervical Cancer Screening: A Study by the French Society of Clinical CytologyAmerican Journal of Clinical Pathology, 2003
- Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practiceand problemsStatistics in Medicine, 2002
- The (In)Validity of sensitivity and specificityStatistics in Medicine, 2000
- Limitations of Sensitivity, Specificity, Likelihood Ratio, and Bayesʼ Theorem in Assessing Diagnostic ProbabilitiesEpidemiology, 1997
- Comparison of the sensitivity and specificity of exercise electrocardiography in biased and unbiased populations of men and womenAmerican Heart Journal, 1995
- AN INTERNATIONAL TERMINOLOGY OF COLPOSCOPY: REPORT OF THE NOMENCLATURE COMMITTEE OF THE INTERNATIONAL FEDERATION OF CERVICAL PATHOLOGY AND COLPOSCOPYObstetrics & Gynecology, 1991
- A model for assessing the sensitivity and specificity of tests subject to selection biasJournal of Chronic Diseases, 1986
- Regression modelling strategies for improved prognostic predictionStatistics in Medicine, 1984
- Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic TestsNew England Journal of Medicine, 1978