Validity of Bronchiolitis Outcome Measures
- 1 June 2015
- journal article
- research article
- Published by American Academy of Pediatrics (AAP) in PEDIATRICS
- Vol. 135 (6), e1399-e1408
- https://doi.org/10.1542/peds.2014-3557
Abstract
BACKGROUND: The Respiratory Distress Assessment Instrument (RDAI) and Respiratory Assessment Change Score (RACS) are frequently used in bronchiolitis clinical trials, but evidence is limited on their measurement properties. We investigated their validity, reliability, and responsiveness. METHODS: We included data from up to 1765 infants with bronchiolitis enrolled in 2 studies conducted in pediatric emergency departments. We assessed RDAI construct validity by testing hypotheses of associations with physiologic measures (respiratory rate, oxygen saturation) and with constructs related to hospitalization, using correlation coefficients, and multivariable analysis. RDAI/RACS responsiveness was evaluated by using anchors of change based on these constructs; measures of responsiveness included the area under the curve. RDAI test-retest agreement and interrater reliability were evaluated by using limits of agreement and intraclass correlation coefficients. RESULTS: Baseline RDAI scores were weakly correlated with respiratory rate (r = 0.38, P < .001), and scores increased in lower oxygen saturation categories (P < .001). Higher RDAI scores were associated with hospitalization (odds ratio: 1.36; 95% confidence interval: 1.26–1.47); scores differed between participants who were discharged, admitted, or stayed in the emergency department (P < .001). Our hypotheses were met, but the magnitude of associations was below our predefined thresholds. RDAI test-retest limits of agreement were −3.80 to 3.64 (20% of the range), whereas interrater reliability was good (intraclass correlation coefficient = 0.93). Formulated hypotheses for responsiveness were confirmed, with moderate responsiveness (area under the curve: RDAI, 0.64–0.70; RACS, 0.72). CONCLUSIONS: RDAI has poor to moderate construct validity, with good discriminative properties but considerable test-retest measurement error. The RDAI and RACS are responsive measures of respiratory distress in bronchiolitis but do not encompass all determinants of disease severity.Keywords
This publication has 27 references indexed in Scilit:
- Prospective Multicenter Study of Children With Bronchiolitis Requiring Mechanical VentilationPediatrics, 2012
- The Cochrane Library and the Treatment of Bronchiolitis in Children: An Overview of ReviewsEvidence-Based Child Health: A Cochrane Review Journal, 2011
- The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomesJournal of Clinical Epidemiology, 2010
- Prospective Multicenter Bronchiolitis Study: Predicting Intensive Care Unit AdmissionsAcademic Emergency Medicine, 2008
- When to use agreement versus reliability measuresJournal of Clinical Epidemiology, 2006
- Bronchiolitis in US Emergency Departments 1992 to 2000Pediatric Emergency Care, 2005
- Practice Variation among Pediatric Emergency Departments in the Treatment of BronchiolitisAcademic Emergency Medicine, 2004
- Performance of a Novel Clinical Score, the Pediatric Asthma Severity Score (PASS), in the Evaluation of Acute AsthmaAcademic Emergency Medicine, 2004
- Performance of a Novel Clinical Score, the Pediatric Asthma Severity Score (PASS), in the Evaluation of Acute AsthmaAcademic Emergency Medicine, 2004
- Dexamethasone in salbutamol-treated inpatients with acute bronchiolitis: A randomized, controlled trialThe Journal of Pediatrics, 1997