Assessing repeatability and reproducibility of Anterior Active Rhinomanometry (AAR) in children.
Anterior Active Rhinomanometry
Children
Coefficient of Variation
Intraclass Correlation Coefficient
Repeatability
Rhinitis
Journal
BMC medical research methodology
ISSN: 1471-2288
Titre abrégé: BMC Med Res Methodol
Pays: England
ID NLM: 100968545
Informations de publication
Date de publication:
17 04 2020
17 04 2020
Historique:
received:
26
04
2019
accepted:
05
04
2020
entrez:
19
4
2020
pubmed:
19
4
2020
medline:
22
6
2021
Statut:
epublish
Résumé
Repeatability and reproducibility are essential for clinicians for several purposes. Although discouraged, use of the Coefficient of Variation (CV) for assessing repeatability and reproducibility, rather than the Intraclass Correlation Coefficient (ICC), is still widespread. The aim of the present study was to highlight how using inappropriate indices may lead to misleading results, and this is done by simulation study and using real data on Anterior Active Rhinomanometry (AAR) in both healthy children and ones with rhinitis. A simulation study was carried out to highlight how using inappropriate indices could be misleading. Then a comparison was made between CV and ICC to assess repeatability and reproducibility of AAR, for which previous studies have given underestimated results. AAR is recommended as the gold standard tool for measuring nasal resistance in clinical practice. A simulation study showed that the ICCs estimated from data generated assuming a true CV yielded results in agreement with estimated CVs; by contrast, if data were generated assuming a true ICC, CVs yielded conflicting results. For AAR, ICCs showed good repeatability, whereas CVs showed unacceptable repeatability. AUC and 95% CI for AAR showed good performance in predicting current symptoms of rhinitis in the overall study population. The present study focused on the importance of the choice of appropriate indices of repeatability and reproducibility, demonstrating the repeatability of AAR in both healthy children and ones with rhinitis. ClinicalTrials.gov (ID: NCT03286049; Registration Date: September 15, 2017; Actual Study Start Date: January 10, 2018).
Sections du résumé
BACKGROUND
Repeatability and reproducibility are essential for clinicians for several purposes. Although discouraged, use of the Coefficient of Variation (CV) for assessing repeatability and reproducibility, rather than the Intraclass Correlation Coefficient (ICC), is still widespread. The aim of the present study was to highlight how using inappropriate indices may lead to misleading results, and this is done by simulation study and using real data on Anterior Active Rhinomanometry (AAR) in both healthy children and ones with rhinitis.
METHODS
A simulation study was carried out to highlight how using inappropriate indices could be misleading. Then a comparison was made between CV and ICC to assess repeatability and reproducibility of AAR, for which previous studies have given underestimated results. AAR is recommended as the gold standard tool for measuring nasal resistance in clinical practice.
RESULTS
A simulation study showed that the ICCs estimated from data generated assuming a true CV yielded results in agreement with estimated CVs; by contrast, if data were generated assuming a true ICC, CVs yielded conflicting results. For AAR, ICCs showed good repeatability, whereas CVs showed unacceptable repeatability. AUC and 95% CI for AAR showed good performance in predicting current symptoms of rhinitis in the overall study population.
CONCLUSIONS
The present study focused on the importance of the choice of appropriate indices of repeatability and reproducibility, demonstrating the repeatability of AAR in both healthy children and ones with rhinitis.
TRIAL REGISTRATION
ClinicalTrials.gov (ID: NCT03286049; Registration Date: September 15, 2017; Actual Study Start Date: January 10, 2018).
Identifiants
pubmed: 32303189
doi: 10.1186/s12874-020-00969-1
pii: 10.1186/s12874-020-00969-1
pmc: PMC7164275
doi:
Banques de données
ClinicalTrials.gov
['NCT03286049']
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
86Références
Lancet. 1986 Feb 8;1(8476):307-10
pubmed: 2868172
Clin Chem. 1989 Apr;35(4):630-1
pubmed: 2702747
J Immunol Methods. 2012 Feb 28;376(1-2):97-107
pubmed: 22197974
Clin Otolaryngol. 2009 Dec;34(6):518-25
pubmed: 20070760
Stat Methods Med Res. 1999 Jun;8(2):135-60
pubmed: 10501650
Methods Inf Med. 2019 Dec;58(S 02):e27-e42
pubmed: 31746447
Am J Rhinol. 1999 Mar-Apr;13(2):131-5
pubmed: 10219442
Rhinology. 1984 Sep;22(3):151-5
pubmed: 6505516
Eur Respir J. 1995 Mar;8(3):483-91
pubmed: 7789502
Clin Otolaryngol Allied Sci. 2000 Dec;25(6):499-503
pubmed: 11122288
J Breath Res. 2019 May 01;13(3):036007
pubmed: 30965288
Biometrics. 1988 Sep;44(3):837-45
pubmed: 3203132
Rhinology. 2011 Mar;49(1):46-52
pubmed: 21468374
Acta Otolaryngol. 1982 Nov-Dec;94(5-6):523-9
pubmed: 7180423
BMC Bioinformatics. 2011 Mar 17;12:77
pubmed: 21414208
Ultrasound Obstet Gynecol. 2008 Apr;31(4):466-75
pubmed: 18306169
Clin Rehabil. 1998 Jun;12(3):187-99
pubmed: 9688034
Stat Med. 2012 Dec 20;31(29):3972-81
pubmed: 22764084
Eur Rev Med Pharmacol Sci. 2013 Nov;17(21):2962-7
pubmed: 24254568
Clin Pharmacol Ther. 1981 Jan;29(1):111-23
pubmed: 7460469
Caspian J Intern Med. 2013 Spring;4(2):627-35
pubmed: 24009950
BMC Med Res Methodol. 2018 Sep 12;18(1):93
pubmed: 30208858
Biometrics. 1977 Mar;33(1):159-74
pubmed: 843571