Determining the Agreement Between an Automated Respiratory Rate Counter and a Reference Standard for Detecting Symptoms of Pneumonia in Children: Protocol for a Cross-Sectional Study in Ethiopia.

Ethiopia child diagnostics pneumonia respiratory rate

Journal

JMIR research protocols
ISSN: 1929-0748
Titre abrégé: JMIR Res Protoc
Pays: Canada
ID NLM: 101599504

Informations de publication

Date de publication:
02 Apr 2020
Historique:
received: 16 10 2019
accepted: 14 01 2020
revised: 03 01 2020
entrez: 3 4 2020
pubmed: 3 4 2020
medline: 3 4 2020
Statut: epublish

Résumé

Acute respiratory infections (ARIs), primarily pneumonia, are the leading infectious cause of under-5 mortality worldwide. Manually counting respiratory rate (RR) for 60 seconds using an ARI timer is commonly practiced by community health workers to detect fast breathing, an important sign of pneumonia. However, correctly counting breaths manually and classifying the RR is challenging, often leading to inappropriate treatment. A potential solution is to introduce RR counters, which count and classify RR automatically. This study aims to determine how the RR count of an Automated Respiratory Infection Diagnostic Aid (ARIDA) agrees with the count of an expert panel of pediatricians counting RR by reviewing a video of the child's chest for 60 seconds (reference standard), for children aged younger than 5 years with cough and/or difficult breathing. A cross-sectional study aiming to enroll 290 children aged 0 to 59 months presenting to pediatric in- and outpatient departments at a teaching hospital in Addis Ababa, Ethiopia, was conducted. Enrollment occurred between April and May 2017. Once enrolled, children participated in at least one of three types of RR evaluations: (1) agreement-measure the RR count of an ARIDA in comparison with the reference standard, (2) consistency-measure the agreement between two ARIDA devices strapped to one child, and (3) RR fluctuation-measure RR count variability over time after ARIDA attachment as measured by a manual count. The agreement and consistency of expert clinicians (ECs) counting RR for the same child with the Mark 2 ARI timer for 60 seconds was also measured in comparison with the reference standard. Primary outcomes were (1) mean difference between the ARIDA and reference standard RR count (agreement) and (2) mean difference between RR counts obtained by two ARIDA devices started simultaneously (consistency). Study strengths included the design allowing for comparison between both ARIDA and the EC with the reference standard RR count. A limitation is that exactly the same set of breaths were not compared between ARIDA and the reference standard since ARIDA can take longer than 60 seconds to count RR. Also, manual RR counting, even when aided by a video of the child's chest movements, is subject to human error and can result in low interrater reliability. Further work is needed to reach global consensus on the most appropriate reference standard and an acceptable level of agreement to provide ministries of health with evidence to make an informed decision on whether to scale up new automated RR counters. ClinicalTrials.gov NCT03067558; https://clinicaltrials.gov/ct2/show/NCT03067558. RR1-10.2196/16531.

Sections du résumé

BACKGROUND BACKGROUND
Acute respiratory infections (ARIs), primarily pneumonia, are the leading infectious cause of under-5 mortality worldwide. Manually counting respiratory rate (RR) for 60 seconds using an ARI timer is commonly practiced by community health workers to detect fast breathing, an important sign of pneumonia. However, correctly counting breaths manually and classifying the RR is challenging, often leading to inappropriate treatment. A potential solution is to introduce RR counters, which count and classify RR automatically.
OBJECTIVE OBJECTIVE
This study aims to determine how the RR count of an Automated Respiratory Infection Diagnostic Aid (ARIDA) agrees with the count of an expert panel of pediatricians counting RR by reviewing a video of the child's chest for 60 seconds (reference standard), for children aged younger than 5 years with cough and/or difficult breathing.
METHODS METHODS
A cross-sectional study aiming to enroll 290 children aged 0 to 59 months presenting to pediatric in- and outpatient departments at a teaching hospital in Addis Ababa, Ethiopia, was conducted. Enrollment occurred between April and May 2017. Once enrolled, children participated in at least one of three types of RR evaluations: (1) agreement-measure the RR count of an ARIDA in comparison with the reference standard, (2) consistency-measure the agreement between two ARIDA devices strapped to one child, and (3) RR fluctuation-measure RR count variability over time after ARIDA attachment as measured by a manual count. The agreement and consistency of expert clinicians (ECs) counting RR for the same child with the Mark 2 ARI timer for 60 seconds was also measured in comparison with the reference standard.
RESULTS RESULTS
Primary outcomes were (1) mean difference between the ARIDA and reference standard RR count (agreement) and (2) mean difference between RR counts obtained by two ARIDA devices started simultaneously (consistency).
CONCLUSIONS CONCLUSIONS
Study strengths included the design allowing for comparison between both ARIDA and the EC with the reference standard RR count. A limitation is that exactly the same set of breaths were not compared between ARIDA and the reference standard since ARIDA can take longer than 60 seconds to count RR. Also, manual RR counting, even when aided by a video of the child's chest movements, is subject to human error and can result in low interrater reliability. Further work is needed to reach global consensus on the most appropriate reference standard and an acceptable level of agreement to provide ministries of health with evidence to make an informed decision on whether to scale up new automated RR counters.
TRIAL REGISTRATION BACKGROUND
ClinicalTrials.gov NCT03067558; https://clinicaltrials.gov/ct2/show/NCT03067558.
INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) UNASSIGNED
RR1-10.2196/16531.

Identifiants

pubmed: 32238340
pii: v9i4e16531
doi: 10.2196/16531
pmc: PMC7163412
doi:

Banques de données

ClinicalTrials.gov
['NCT03067558']

Types de publication

Journal Article

Langues

eng

Pagination

e16531

Informations de copyright

©Charlotte Ward, Kevin Baker, Sarah Marks, Dawit Getachew, Tedila Habte, Cindy McWhorter, Paul Labarre, Jonathan Howard-Brand, Nathan P Miller, Hayalnesh Tarekegn, Solomie Jebessa Deribessa, Max Petzold, Karin Kallander. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 02.04.2020.

Références

Lancet. 1986 Feb 8;1(8476):307-10
pubmed: 2868172
Trop Med Int Health. 2015 Jun;20(6):757-65
pubmed: 25728867
Ethiop Med J. 2014 Oct;52 Suppl 3:15-26
pubmed: 25845070
PLoS One. 2014 Jun 11;9(6):e99266
pubmed: 24919062
Lancet Respir Med. 2014 Dec;2(12):950-2
pubmed: 25466341
Trans R Soc Trop Med Hyg. 2006 Oct;100(10):956-63
pubmed: 16455119
Am J Trop Med Hyg. 2012 Nov;87(5 Suppl):6-10
pubmed: 23136272
PLoS One. 2016 Mar 24;11(3):e0152204
pubmed: 27011331
Lancet Glob Health. 2019 Jan;7(1):e47-e57
pubmed: 30497986
Int J Nurs Stud. 2015 May;52(5):963-9
pubmed: 25712876
Lancet Glob Health. 2013 Dec;1(6):e326-7
pubmed: 25104591
Trop Med Int Health. 2017 Feb;22(2):139-147
pubmed: 27862739
Trop Med Int Health. 2011 Oct;16(10):1234-42
pubmed: 21752163
Lancet. 2015 Jan 31;385(9966):466-76
pubmed: 24990815

Auteurs

Charlotte Ward (C)

Malaria Consortium, London, United Kingdom.

Kevin Baker (K)

Malaria Consortium, London, United Kingdom.
Department of Public Health Sciences, Karolinska Institutet, Solnavägen, Sweden.

Sarah Marks (S)

Malaria Consortium, London, United Kingdom.

Dawit Getachew (D)

Malaria Consortium, Addis Ababa, Ethiopia.

Tedila Habte (T)

Malaria Consortium, Addis Ababa, Ethiopia.

Cindy McWhorter (C)

United Nations Children's Fund Supply Division, Copenhagen, Denmark.

Paul Labarre (P)

United Nations Children's Fund Supply Division, Copenhagen, Denmark.

Jonathan Howard-Brand (J)

United Nations Children's Fund Supply Division, Copenhagen, Denmark.

Nathan P Miller (NP)

United Nations Children's Fund Programme Division, New York, NY, United States.

Hayalnesh Tarekegn (H)

United Nations Children's Fund Programme Division, New York, NY, United States.

Solomie Jebessa Deribessa (SJ)

St Paul's Hospital Millennium Medical College, Addis Ababa, Ethiopia.

Max Petzold (M)

School of Public Health and Community Medicine, Institute of Medicine, University of Gothenburg, Gothenburg, Sweden.

Karin Kallander (K)

Malaria Consortium, London, United Kingdom.
Department of Public Health Sciences, Karolinska Institutet, Solnavägen, Sweden.
United Nations Children's Fund Programme Division, New York, NY, United States.

Classifications MeSH