Determining the Agreement Between an Automated Respiratory Rate Counter and a Reference Standard for Detecting Symptoms of Pneumonia in Children: Protocol for a Cross-Sectional Study in Ethiopia.
Ethiopia
child
diagnostics
pneumonia
respiratory rate
Journal
JMIR research protocols
ISSN: 1929-0748
Titre abrégé: JMIR Res Protoc
Pays: Canada
ID NLM: 101599504
Informations de publication
Date de publication:
02 Apr 2020
02 Apr 2020
Historique:
received:
16
10
2019
accepted:
14
01
2020
revised:
03
01
2020
entrez:
3
4
2020
pubmed:
3
4
2020
medline:
3
4
2020
Statut:
epublish
Résumé
Acute respiratory infections (ARIs), primarily pneumonia, are the leading infectious cause of under-5 mortality worldwide. Manually counting respiratory rate (RR) for 60 seconds using an ARI timer is commonly practiced by community health workers to detect fast breathing, an important sign of pneumonia. However, correctly counting breaths manually and classifying the RR is challenging, often leading to inappropriate treatment. A potential solution is to introduce RR counters, which count and classify RR automatically. This study aims to determine how the RR count of an Automated Respiratory Infection Diagnostic Aid (ARIDA) agrees with the count of an expert panel of pediatricians counting RR by reviewing a video of the child's chest for 60 seconds (reference standard), for children aged younger than 5 years with cough and/or difficult breathing. A cross-sectional study aiming to enroll 290 children aged 0 to 59 months presenting to pediatric in- and outpatient departments at a teaching hospital in Addis Ababa, Ethiopia, was conducted. Enrollment occurred between April and May 2017. Once enrolled, children participated in at least one of three types of RR evaluations: (1) agreement-measure the RR count of an ARIDA in comparison with the reference standard, (2) consistency-measure the agreement between two ARIDA devices strapped to one child, and (3) RR fluctuation-measure RR count variability over time after ARIDA attachment as measured by a manual count. The agreement and consistency of expert clinicians (ECs) counting RR for the same child with the Mark 2 ARI timer for 60 seconds was also measured in comparison with the reference standard. Primary outcomes were (1) mean difference between the ARIDA and reference standard RR count (agreement) and (2) mean difference between RR counts obtained by two ARIDA devices started simultaneously (consistency). Study strengths included the design allowing for comparison between both ARIDA and the EC with the reference standard RR count. A limitation is that exactly the same set of breaths were not compared between ARIDA and the reference standard since ARIDA can take longer than 60 seconds to count RR. Also, manual RR counting, even when aided by a video of the child's chest movements, is subject to human error and can result in low interrater reliability. Further work is needed to reach global consensus on the most appropriate reference standard and an acceptable level of agreement to provide ministries of health with evidence to make an informed decision on whether to scale up new automated RR counters. ClinicalTrials.gov NCT03067558; https://clinicaltrials.gov/ct2/show/NCT03067558. RR1-10.2196/16531.
Sections du résumé
BACKGROUND
BACKGROUND
Acute respiratory infections (ARIs), primarily pneumonia, are the leading infectious cause of under-5 mortality worldwide. Manually counting respiratory rate (RR) for 60 seconds using an ARI timer is commonly practiced by community health workers to detect fast breathing, an important sign of pneumonia. However, correctly counting breaths manually and classifying the RR is challenging, often leading to inappropriate treatment. A potential solution is to introduce RR counters, which count and classify RR automatically.
OBJECTIVE
OBJECTIVE
This study aims to determine how the RR count of an Automated Respiratory Infection Diagnostic Aid (ARIDA) agrees with the count of an expert panel of pediatricians counting RR by reviewing a video of the child's chest for 60 seconds (reference standard), for children aged younger than 5 years with cough and/or difficult breathing.
METHODS
METHODS
A cross-sectional study aiming to enroll 290 children aged 0 to 59 months presenting to pediatric in- and outpatient departments at a teaching hospital in Addis Ababa, Ethiopia, was conducted. Enrollment occurred between April and May 2017. Once enrolled, children participated in at least one of three types of RR evaluations: (1) agreement-measure the RR count of an ARIDA in comparison with the reference standard, (2) consistency-measure the agreement between two ARIDA devices strapped to one child, and (3) RR fluctuation-measure RR count variability over time after ARIDA attachment as measured by a manual count. The agreement and consistency of expert clinicians (ECs) counting RR for the same child with the Mark 2 ARI timer for 60 seconds was also measured in comparison with the reference standard.
RESULTS
RESULTS
Primary outcomes were (1) mean difference between the ARIDA and reference standard RR count (agreement) and (2) mean difference between RR counts obtained by two ARIDA devices started simultaneously (consistency).
CONCLUSIONS
CONCLUSIONS
Study strengths included the design allowing for comparison between both ARIDA and the EC with the reference standard RR count. A limitation is that exactly the same set of breaths were not compared between ARIDA and the reference standard since ARIDA can take longer than 60 seconds to count RR. Also, manual RR counting, even when aided by a video of the child's chest movements, is subject to human error and can result in low interrater reliability. Further work is needed to reach global consensus on the most appropriate reference standard and an acceptable level of agreement to provide ministries of health with evidence to make an informed decision on whether to scale up new automated RR counters.
TRIAL REGISTRATION
BACKGROUND
ClinicalTrials.gov NCT03067558; https://clinicaltrials.gov/ct2/show/NCT03067558.
INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)
UNASSIGNED
RR1-10.2196/16531.
Identifiants
pubmed: 32238340
pii: v9i4e16531
doi: 10.2196/16531
pmc: PMC7163412
doi:
Banques de données
ClinicalTrials.gov
['NCT03067558']
Types de publication
Journal Article
Langues
eng
Pagination
e16531Informations de copyright
©Charlotte Ward, Kevin Baker, Sarah Marks, Dawit Getachew, Tedila Habte, Cindy McWhorter, Paul Labarre, Jonathan Howard-Brand, Nathan P Miller, Hayalnesh Tarekegn, Solomie Jebessa Deribessa, Max Petzold, Karin Kallander. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 02.04.2020.
Références
Lancet. 1986 Feb 8;1(8476):307-10
pubmed: 2868172
Trop Med Int Health. 2015 Jun;20(6):757-65
pubmed: 25728867
Ethiop Med J. 2014 Oct;52 Suppl 3:15-26
pubmed: 25845070
PLoS One. 2014 Jun 11;9(6):e99266
pubmed: 24919062
Lancet Respir Med. 2014 Dec;2(12):950-2
pubmed: 25466341
Trans R Soc Trop Med Hyg. 2006 Oct;100(10):956-63
pubmed: 16455119
Am J Trop Med Hyg. 2012 Nov;87(5 Suppl):6-10
pubmed: 23136272
PLoS One. 2016 Mar 24;11(3):e0152204
pubmed: 27011331
Lancet Glob Health. 2019 Jan;7(1):e47-e57
pubmed: 30497986
Int J Nurs Stud. 2015 May;52(5):963-9
pubmed: 25712876
Lancet Glob Health. 2013 Dec;1(6):e326-7
pubmed: 25104591
Trop Med Int Health. 2017 Feb;22(2):139-147
pubmed: 27862739
Trop Med Int Health. 2011 Oct;16(10):1234-42
pubmed: 21752163
Lancet. 2015 Jan 31;385(9966):466-76
pubmed: 24990815