Imputing the Number of Responders from the Mean and Standard Deviation of CGI-Improvement in Clinical Trials Investigating Medications for Autism Spectrum Disorder
Open Access
- 9 July 2021
- journal article
- research article
- Published by MDPI AG in Brain Sciences
- Vol. 11 (7), 908
- https://doi.org/10.3390/brainsci11070908
Abstract
Introduction: Response to treatment, according to Clinical Global Impression-Improvement (CGI-I) scale, is an easily interpretable outcome in clinical trials of autism spectrum disorder (ASD). Yet, the CGI-I rating is sometimes reported as a continuous outcome, and converting it to dichotomous would allow meta-analysis to incorporate more evidence. Methods: Clinical trials investigating medications for ASD and presenting both dichotomous and continuous CGI-I data were included. The number of patients with at least much improvement (CGI-I ≤ 2) were imputed from the CGI-I scale, assuming an underlying normal distribution of a latent continuous score using a primary threshold θ = 2.5 instead of θ = 2, which is the original cut-off in the CGI-I scale. The original and imputed values were used to calculate responder rates and odds ratios. The performance of the imputation method was investigated with a concordance correlation coefficient (CCC), linear regression, Bland–Altman plots, and subgroup differences of summary estimates obtained from random-effects meta-analysis. Results: Data from 27 studies, 58 arms, and 1428 participants were used. The imputation method using the primary threshold (θ = 2.5) had good performance for the responder rates (CCC = 0.93 95% confidence intervals [0.86, 0.96]; β of linear regression = 1.04 [0.95, 1.13]; bias and limits of agreements = 4.32% [−8.1%, 16.74%]; no subgroup differences χ2 = 1.24, p-value = 0.266) and odds ratios (CCC = 0.91 [0.86, 0.96]; β = 0.96 [0.78, 1.14]; bias = 0.09 [−0.87, 1.04]; χ2 = 0.02, p-value = 0.894). The imputation method had poorer performance when the secondary threshold (θ = 2) was used. Discussion: Assuming a normal distribution of the CGI-I scale, the number of responders could be imputed from the mean and standard deviation and used in meta-analysis. Due to the wide limits of agreement of the imputation method, sensitivity analysis excluding studies with imputed values should be performed.Funding Information
- Innovative Medicines Initiative (777394)
This publication has 27 references indexed in Scilit:
- Odds ratios of treatment response were well approximated from continuous rating scale scores for meta-analysisJournal of Clinical Epidemiology, 2015
- Systematic review of tools to measure outcomes for young children with autism spectrum disorderHealth Technology Assessment, 2015
- Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorderAutism, 2014
- Brief Report: “Quick and (not so) Dirty” Assessment of Change in Autism: Cross-Cultural Reliability of the Developmental Disabilities CGAS and the OSU Autism CGIJournal of Autism and Developmental Disorders, 2013
- Measuring repetitive behaviors as a treatment endpoint in youth with autism spectrum disorderAutism, 2013
- Imputation of response rates from means and standard deviations in schizophreniaSchizophrenia Research, 2013
- Relative indices of treatment effect may be constant across different definitions of response in schizophrenia trialsSchizophrenia Research, 2011
- Lack of Efficacy of Citalopram in Children With Autism Spectrum Disorders and High Levels of Repetitive BehaviorArchives of General Psychiatry, 2009
- STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENTThe Lancet, 1986