Validity, reliability and responsiveness of digital visual analogue scales for chronic spontaneous urticaria monitoring: A CRUSE® mobile health study.
mHealth
patient‐reported outcome measures
urticaria, chronic spontaneous urticaria
Journal
Allergy
ISSN: 1398-9995
Titre abrégé: Allergy
Pays: Denmark
ID NLM: 7804028
Informations de publication
Date de publication:
24 Oct 2024
24 Oct 2024
Historique:
revised:
22
08
2024
received:
30
07
2024
accepted:
11
09
2024
medline:
24
10
2024
pubmed:
24
10
2024
entrez:
24
10
2024
Statut:
aheadofprint
Résumé
CRUSE® is an app that allows patients with chronic spontaneous urticaria (CSU) to monitor their daily disease activity through the use of visual analogue scales (VASs). We aimed to determine the concurrent validity, reliability, responsiveness and minimal important difference (MID) of CRUSE® VASs. We evaluated the properties of three daily VASs: VAS for how much patients were affected by their CSU ('VAS urticaria'), VAS for the impact of urticaria on work/school productivity ('VAS productivity') and the VAS of EQ-5D. Concurrent validity was assessed by measuring the association between each VAS and the Urticaria Activity Score (UAS). Intra-rater reliability was determined based on the data of users providing multiple daily questionnaires within the same day. Test-retest reliability and responsiveness (ability to change), respectively, were tested in clinically stable and clinically unstable users. MIDs were determined using distribution-based methods. We included 5938 patients (67,380 days). Concurrent validity was high, with VAS urticaria being more strongly associated with the UAS score than the remaining VASs. Intra-rater reliability was also high, with intraclass correlation coefficients (ICC) being above 0.950 for all VASs. Moderate-high test-retest reliability and responsiveness were observed, with reliability ICC being highest for VAS EQ-5D and responsiveness being highest for VAS urticaria. The MID for VAS urticaria was 17 (out of 100) units, compared to 15 units for VAS productivity and 11 units for VAS EQ-5D. Daily VASs for CSU available in the CRUSE® app display high concurrent validity and intra-rater reliability and moderate-high test-retest reliability and responsiveness.
Sections du résumé
BACKGROUND
BACKGROUND
CRUSE® is an app that allows patients with chronic spontaneous urticaria (CSU) to monitor their daily disease activity through the use of visual analogue scales (VASs). We aimed to determine the concurrent validity, reliability, responsiveness and minimal important difference (MID) of CRUSE® VASs.
METHODS
METHODS
We evaluated the properties of three daily VASs: VAS for how much patients were affected by their CSU ('VAS urticaria'), VAS for the impact of urticaria on work/school productivity ('VAS productivity') and the VAS of EQ-5D. Concurrent validity was assessed by measuring the association between each VAS and the Urticaria Activity Score (UAS). Intra-rater reliability was determined based on the data of users providing multiple daily questionnaires within the same day. Test-retest reliability and responsiveness (ability to change), respectively, were tested in clinically stable and clinically unstable users. MIDs were determined using distribution-based methods.
RESULTS
RESULTS
We included 5938 patients (67,380 days). Concurrent validity was high, with VAS urticaria being more strongly associated with the UAS score than the remaining VASs. Intra-rater reliability was also high, with intraclass correlation coefficients (ICC) being above 0.950 for all VASs. Moderate-high test-retest reliability and responsiveness were observed, with reliability ICC being highest for VAS EQ-5D and responsiveness being highest for VAS urticaria. The MID for VAS urticaria was 17 (out of 100) units, compared to 15 units for VAS productivity and 11 units for VAS EQ-5D.
CONCLUSION
CONCLUSIONS
Daily VASs for CSU available in the CRUSE® app display high concurrent validity and intra-rater reliability and moderate-high test-retest reliability and responsiveness.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
© 2024 European Academy of Allergy and Clinical Immunology and John Wiley & Sons Ltd.
Références
Baiardini I, Giardini A, Pasquali M, et al. Quality of life and patients' satisfaction in chronic urticaria and respiratory allergy. Allergy. 2003;58(7):621‐623. doi:10.1034/j.1398-9995.2003.00091.x
Goncalo M, Gimenez‐Arnau A, Al‐Ahmad M, et al. The global burden of chronic urticaria for the patient and society. Br J Dermatol. 2021;184(2):226‐236. doi:10.1111/bjd.19561
Maurer M, Abuzakouk M, Berard F, et al. The burden of chronic spontaneous urticaria is substantial: real‐world evidence from ASSURE‐CSU. Allergy. 2017;72(12):2005‐2016. doi:10.1111/all.13209
Bousquet J, Anto JM, Sousa‐Pinto B, et al. Digitally‐enabled, patient‐centred care in rhinitis and asthma multimorbidity: the ARIA‐MASK‐air((R)) approach. Clin Transl Allergy. 2023;13(1):e12215. doi:10.1002/clt2.12215
Anto A, Maurer R, Gimenez‐Arnau A, et al. Automatic screening of self‐evaluation apps for urticaria and angioedema shows a high unmet need. Allergy. 2021;76(12):3810‐3813. doi:10.1111/all.15061
Neisinger S, Sousa Pinto B, Ramanauskaite A, et al. CRUSE((R)) ‐an innovative mobile application for patient monitoring and management in chronic spontaneous urticaria. Clin Transl Allergy. 2024;14(1):e12328. doi:10.1002/clt2.12328
Hawro T, Ohanyan T, Schoepke N, et al. The urticaria activity score‐validity, reliability, and responsiveness. J Allergy Clin Immunol Pract. 2018;6(4):1185‐1190. doi:10.1016/j.jaip.2017.10.001
Weller K, Groffik A, Magerl M, et al. Development, validation, and initial results of the angioedema activity score. Allergy. 2013;68(9):1185‐1192. doi:10.1111/all.12209
Yang Z, Busschbach J, Liu G, Luo N. EQ‐5D‐5L norms for the urban Chinese population in China. Health Qual Life Outcomes. 2018;16(1):210. doi:10.1186/s12955-018-1036-2
Weller K, Groffik A, Church MK, et al. Development and validation of the urticaria control test: a patient‐reported outcome instrument for assessing urticaria control. J Allergy Clin Immunol. 2014;133(5):1365‐1372. doi:10.1016/j.jaci.2013.12.1076
Weller K, Donoso T, Magerl M, et al. Development of the angioedema control test‐a patient‐reported outcome measure that assesses disease control in patients with recurrent angioedema. Allergy. 2020;75(5):1165‐1177. doi:10.1111/all.14144
Weller K, Donoso T, Magerl M, et al. Validation of the angioedema control test (AECT)‐a patient‐reported outcome instrument for assessing angioedema control. J Allergy Clin Immunol Pract. 2020;8(6):2050‐2057. doi:10.1016/j.jaip.2020.02.038
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155‐163. doi:10.1016/j.jcm.2016.02.012
Qin S, Nelson L, McLeod L, Eremenco S, Coons SJ. Assessing test‐retest reliability of patient‐reported outcome measures using intraclass correlation coefficients: recommendations for selecting and documenting the analytical formula. Qual Life Res. 2019;28(4):1029‐1033. doi:10.1007/s11136-018-2076-0
Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53(5):459‐468. doi:10.1016/s0895-4356(99)00206-1
Mouelhi Y, Jouve E, Castelli C, Gentile S. How is the minimal clinically important difference established in health‐related quality of life instruments? Review of anchors and methods. Health Qual Life Outcomes. 2020;18:1‐17.
Rosellini AJ, Brown TA. Developing and validating clinical questionnaires. Annu Rev Clin Psychol. 2021;17:55‐81. doi:10.1146/annurev-clinpsy-081219-115343
Zhang DG, Sorensen JA, Ghazanfar MN, Thomsen SF. Clinical applicability of the urticaria control test in patients with chronic urticaria: further evidence from 622 adult and pediatric patients with different disease subtypes. Allergy. 2024;79(1):263‐264. doi:10.1111/all.15955
Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health Syst Pharm. 2008;65(23):2276‐2284. doi:10.2146/ajhp070364
Chodziuk AC, Ghazanfar MN, Thomsen SF. Use of the patient benefit index to monitor treatment of chronic spontaneous urticaria with omalizumab. Dermatol Ther. 2019;32(3):e12902. doi:10.1111/dth.12902
Zuberbier T, Abdul Latiff AH, Abuzakouk M, et al. The international EAACI/GA(2)LEN/EuroGuiDerm/APAAACI guideline for the definition, classification, diagnosis, and management of urticaria. Allergy. 2022;77(3):734‐766. doi:10.1111/all.15090
Sousa‐Pinto B, Azevedo LF, Jutel M, et al. Development and validation of combined symptom‐medication scores for allergic rhinitis. Allergy. 2022;77(7):2147‐2162. doi:10.1111/all.15199
Sousa‐Pinto B, Jacome C, Pereira AM, et al. Development and validation of an electronic daily control score for asthma (e‐DASTHMA): a real‐world direct patient data study. Lancet Digit Health. 2023;5(4):e227‐e238. doi:10.1016/S2589-7500(23)00020-1
Abreu MIT, Santos AF, Gama JMR, et al. Factors affecting usage of a digital asthma monitoring application by old‐age asthmatics living in inner Central Portugal. Clin Interv Aging. 2024;19:971‐979. doi:10.2147/CIA.S448797
Fonseca JA, Nogueira‐Silva L, Morais‐Almeida M, et al. Control of allergic rhinitis and asthma test (CARAT) can be used to assess individual patients over time. Clin Transl Allergy. 2012;2(1):16. doi:10.1186/2045-7022-2-16
Sousa‐Pinto B, Eklund P, Pfaar O, et al. Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK‐air(R). Clin Transl Allergy. 2021;11(7):e12062. doi:10.1002/clt2.12062
Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient‐reported outcomes. J Clin Epidemiol. 2008;61(2):102‐109. doi:10.1016/j.jclinepi.2007.03.012