Determining the Agreement Between an Automated Respiratory Rate Counter and a Reference Standard for Detecting Symptoms of Pneumonia in Children: Protocol for a Cross-Sectional Study in Ethiopia
Open Access
- 2 April 2020
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 9 (4), e16531
- https://doi.org/10.2196/16531
Abstract
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Acute respiratory infections (ARIs), primarily pneumonia, are the leading infectious cause of under-five mortality worldwide. Manually counting respiratory rate (RR) for 60 seconds using an ARI timer is commonly practiced by community health workers to detect fast breathing, an important sign of pneumonia. However, correctly counting breaths manually and classifying the RR is challenging, often leading to inappropriate treatment. A potential solution is to introduce RR counters which count and classify RR automatically. Objective: This study aims to determine how the RR count of an Automated Respiratory Infection Diagnostic Aid (ARIDA) agrees with the count of an expert panel of paediatricians counting RR by reviewing a video of the child’s chest for 60 seconds (reference standard), for children under five years of age with cough and/or difficult breathing. Methods: A cross-sectional study aiming to enrol 290 children 0-59 months presenting to paediatric in- and out-patient departments at a teaching hospital in Addis Ababa, Ethiopia was conducted. Enrolment occurred between April and May 2017. Once enrolled, children participated in at least one of three types of RR evaluations: 1) agreement – to measure the RR count of ARIDA in comparison to the reference standard, 2) consistency – to measure the agreement between two ARIDA devices strapped to one child and 3) RR fluctuation – to measure RR count variability over time after ARIDA attachment as measured by a manual count. The agreement and consistency of expert clinicians (ECs) counting RR for the same child with the Mark 2 (MK2) ARI timer for 60 seconds was also measured in comparison to the reference standard. Results: Primary outcomes were 1) mean difference between ARIDA and reference standard RR count (agreement) and 2) mean difference between RR counts obtained by two ARIDA devices started simultaneously (consistency). Conclusions: Study strengths included the design allowing for comparison between both ARIDA and the EC with the reference standard RR count. A limitation is that exactly the same set of breaths were not compared between ARIDA and the reference standard since ARIDA can take longer than 60 seconds to count RR. Also, manual RR counting, even when aided by a video of the child’s chest movements, is subject to human error and can result in low inter-rater reliability. Further work is needed to reach global consensus on the most appropriate reference standard and an acceptable level of agreement, to provide Ministries of Health with evidence to make an informed decision on whether to scale up new automated RR counters. Clinical Trial: www.clinicaltrials.gov, identifier NCT03067558Keywords
This publication has 15 references indexed in Scilit:
- Can simple mobile phone applications provide reliable counts of respiratory rates in sick infants and children? An initial evaluation of three new applicationsInternational Journal of Nursing Studies, 2015
- Effect of context on respiratory rate measurement in identifying non‐severe pneumonia in African childrenTropical Medicine & International Health, 2015
- Countdown to 2015 and beyond: fulfilling the health agenda for women and childrenThe Lancet, 2015
- Universal access to pneumonia prevention and care: a call for actionThe Lancet Respiratory Medicine, 2014
- Improving the Accuracy and Efficiency of Respiratory Rate Measurements in Children Using Mobile DevicesPLOS ONE, 2014
- Innovations in pneumonia diagnosis and treatment: a call to action on World Pneumonia Day, 2013The Lancet. Global Health, 2013
- World Health Organization/United Nations Children's Fund Joint Statement on Integrated Community Case Management: An Equity-Focused Strategy to Improve Access to Essential Treatment Services for ChildrenThe American Journal of Tropical Medicine and Hygiene, 2012
- Can lay community health workers be trained to use diagnostics to distinguish and treat malaria and pneumonia in children? Lessons from rural UgandaTropical Medicine & International Health, 2011
- Can community health workers and caretakers recognise pneumonia in children? Experiences from western UgandaTransactions of the Royal Society of Tropical Medicine and Hygiene, 2006
- STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENTThe Lancet, 1986