Estimating sensitivity and specificity of diagnostic tests using latent class models that account for conditional dependence between tests: a simulation study
Open Access
- 10 March 2023
- journal article
- research article
- Published by Springer Science and Business Media LLC in BMC Medical Research Methodology
- Vol. 23 (1), 1-13
- https://doi.org/10.1186/s12874-023-01873-0
Abstract
Latent class models are increasingly used to estimate the sensitivity and specificity of diagnostic tests in the absence of a gold standard, and are commonly fitted using Bayesian methods. These models allow us to account for ‘conditional dependence’ between two or more diagnostic tests, meaning that the results from tests are correlated even after conditioning on the person’s true disease status. The challenge is that it is not always clear to researchers whether conditional dependence exists between tests and whether it exists in all or just some latent classes. Despite the increasingly widespread use of latent class models to estimate diagnostic test accuracy, the impact of the conditional dependence structure chosen on the estimates of sensitivity and specificity remains poorly investigated. A simulation study and a reanalysis of a published case study are used to highlight the impact of the conditional dependence structure chosen on estimates of sensitivity and specificity. We describe and implement three latent class random-effect models with differing conditional dependence structures, as well as a conditional independence model and a model that assumes perfect test accuracy. We assess the bias and coverage of each model in estimating sensitivity and specificity across different data generating mechanisms. The findings highlight that assuming conditional independence between tests within a latent class, where conditional dependence exists, results in biased estimates of sensitivity and specificity and poor coverage. The simulations also reiterate the substantial bias in estimates of sensitivity and specificity when incorrectly assuming a reference test is perfect. The motivating example of tests for Melioidosis highlights these biases in practice with important differences found in estimated test accuracy under different model choices. We have illustrated that misspecification of the conditional dependence structure leads to biased estimates of sensitivity and specificity when there is a correlation between tests. Due to the minimal loss in precision seen by using a more general model, we recommend accounting for conditional dependence even if researchers are unsure of its presence or it is only expected at minimal levels.Keywords
This publication has 23 references indexed in Scilit:
- Current Approaches for Diagnosis of Influenza Virus Infections in HumansViruses, 2016
- ggplot2Published by Springer Science and Business Media LLC ,2016
- Defining the True Sensitivity of Culture for the Diagnosis of Melioidosis Using Bayesian Latent Class ModelsPLOS ONE, 2010
- Sensitivities and Specificities of Diagnostic Tests and Infection Prevalence of Schistosoma haematobium Estimated from Data on Adults in Villages Northwest of Accra, GhanaThe American Journal of Tropical Medicine and Hygiene, 2009
- Bayesian latent class models with conditionally dependent diagnostic tests: A case studyStatistics in Medicine, 2008
- Prospective evaluation of a rapid immunochromogenic cassette test for the diagnosis of melioidosis in northeast ThailandTransactions of the Royal Society of Tropical Medicine and Hygiene, 2006
- Nucleic acid amplification tests in the diagnosis of tuberculous pleuritis: a systematic review and meta-analysisBMC Infectious Diseases, 2004
- Bayesian Approaches to Modeling the Conditional Dependence Between Multiple Diagnostic TestsBiometrics, 2001
- Effects of dependent errors in the assessment of diagnostic test performanceStatistics in Medicine, 1997
- Estimation of test error rates, disease prevalence and relative risk from misclassified data: a reviewJournal of Clinical Epidemiology, 1988