Accounting for complex intracluster correlations in longitudinal cluster randomized trials: a case study in malaria vector control
Open Access
- 17 March 2023
- journal article
- research article
- Published by Springer Science and Business Media LLC in BMC Medical Research Methodology
- Vol. 23 (1), 1-10
- https://doi.org/10.1186/s12874-023-01871-2
Abstract
The effectiveness of malaria vector control interventions is often evaluated using cluster randomized trials (CRT) with outcomes assessed using repeated cross-sectional surveys. A key requirement for appropriate design and analysis of longitudinal CRTs is accounting for the intra-cluster correlation coefficient (ICC). In addition to exchangeable correlation (constant ICC over time), correlation structures proposed for longitudinal CRT are block exchangeable (allows a different within- and between-period ICC) and exponential decay (allows between-period ICC to decay exponentially). More flexible correlation structures are available in statistical software packages and, although not formally proposed for longitudinal CRTs, may offer some advantages. Our objectives were to empirically explore the impact of these correlation structures on treatment effect inferences, identify gaps in the methodological literature, and make practical recommendations. We obtained data from a parallel-arm CRT conducted in Tanzania to compare four different types of insecticide-treated bed-nets. Malaria prevalence was assessed in cross-sectional surveys of 45 households in each of 84 villages at baseline, 12-, 18- and 24-months post-randomization. We re-analyzed the data using mixed-effects logistic regression according to a prespecified analysis plan but under five different correlation structures as well as a robust variance estimator under exchangeable correlation and compared the estimated correlations and treatment effects. A proof-of-concept simulation was conducted to explore general conclusions. The estimated correlation structures varied substantially across different models. The unstructured model was the best-fitting model based on information criteria. Although point estimates and confidence intervals for the treatment effect were similar, allowing for more flexible correlation structures led to different conclusions based on statistical significance. Use of robust variance estimators generally led to wider confidence intervals. Simulation results showed that under-specification can lead to coverage probabilities much lower than nominal levels, but over-specification is more likely to maintain nominal coverage. More flexible correlation structures should not be ruled out in longitudinal CRTs. This may be particularly important in malaria trials where outcomes may fluctuate over time. In the absence of robust methods for selecting the best-fitting correlation structure, researchers should examine sensitivity of results to different assumptions about the ICC and consider robust variance estimators.Keywords
This publication has 20 references indexed in Scilit:
- Bias and inference from misspecified mixed-effect models in stepped wedge trial analysisStatistics in Medicine, 2017
- Sample size calculation for stepped wedge and other longitudinal cluster randomised trialsStatistics in Medicine, 2016
- Statistical efficiency and optimal design for stepped cluster studies under linear mixed effects modelsStatistics in Medicine, 2016
- Comparison of methods for estimating the intraclass correlation coefficient for binary responses in cancer prevention cluster randomized trialsContemporary Clinical Trials, 2012
- Specification of covariance structure in longitudinal data analysis for randomized clinical trialsStatistics in Medicine, 2009
- Design and analysis of stepped wedge cluster randomized trialsContemporary Clinical Trials, 2007
- Efficient Laplacian and Adaptive Gaussian Quadrature Algorithms for Multilevel Generalized Linear Mixed ModelsJournal of Computational and Graphical Statistics, 2006
- Analysis of data from group-randomized trials with repeat observations on the same groupsStatistics in Medicine, 1998
- A comparison of two approaches for selecting covariance structures in the analysis of repeated measurementsCommunications in Statistics - Simulation and Computation, 1998
- Design considerations in the estimation of intraclass correlationAnnals of Human Genetics, 1982