Study of interobserver reliability in clinical assessment of RSV lower respiratory illness: A pediatric investigators collaborative network for infections in Canada (PICNIC) study
- 1 July 1996
- journal article
- clinical trial
- Published by Wiley in Pediatric Pulmonology
Abstract
Randomized trials of ribavirin therapy have used clinical scores to assess illness severity. Little information on agreement for these findings between observers has been published. We decided to determine interobserver agreement for (1) a history for apnea or respiratory failure; (2) assessment of cyanosis, respiratory rate, retractions, and oximetry; and (3) determination of reason for hospitalization (requirement for medications, supportive care, underlying illness, poor home environment). At eight centers 137 RSV‐infected patients were assessed by two observers blinded to the assessments by others with no interventions made between assessments. Observations were categorized, and agreement was summarized as percentage of observed agreement, Pearson correlation, or as a κ statistic. Observed agreement for a history of either apnea or a respiratory arrest was at least 90% at all centers, with seven of the eight centers in total agreement. At all centers except one, the agreement on the reason why the patient remained in hospital was at least 80%. The observed agreement for assessing cyanosis was at least 94% at all eight centers. The correlation coefficient for respiratory rate varied from 0.42 to 0.97 across centers. The κ values for agreement beyond chance for retractions varied from 0.05 to 1.00. The κ values for oxygen saturation measures varied from 0.31 to 0.70. Although not statistically significant, there appeared to be more variation as the time between assessments increased. In conclusion, agreement for historical findings and assessment of cyanosis was high. However, there was wide variation in agreement in the other assessments. Training to ensure consistent and reproducible assessment by different examiners will be necessary if these findings are to be used as outcome variables in clinical trials. Pediatr Pulmonol. 1996;22;23–27.Keywords
This publication has 16 references indexed in Scilit:
- Pediatric Investigators Collaborative Network on Infections in Canada (PICNIC) prospective study of risk factors and outcomes in patients hospitalized with respiratory syncytial viral lower respiratory tract infectionThe Journal of Pediatrics, 1995
- Effect of racemic epinephrine and salbutamol on clinical score and pulmonary mechanics in infants with bronchiolitisThe Journal of Pediatrics, 1993
- Randomized trial of salbutamol in acute bronchiolitisThe Journal of Pediatrics, 1991
- Nebulized albuterol in acute bronchiolitisThe Journal of Pediatrics, 1990
- Study design considerations for ribavirin: efficacy studiesThe Pediatric Infectious Disease Journal, 1990
- Aerosolized ribavirin in the treatment of patients with respiratory syncytial virus diseaseThe Pediatric Infectious Disease Journal, 1987
- Interobserver Variation in Assessment of Respiratory SignsActa Medica Scandinavica, 1984
- Aerosolized Ribavirin Treatment of Infants with Respiratory Syncytial Viral InfectionNew England Journal of Medicine, 1983
- Repeatability of physical signs in airways obstructionThorax, 1969
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960