A WeChat applet-based national remote emergency system for malignant hyperthermia in China: a usability study.
Anesthesiology
Malignant hyperthermia
Reliability and validity
Survey methods
Usability testing
mHealth
Journal
BMC medical informatics and decision making
ISSN: 1472-6947
Titre abrégé: BMC Med Inform Decis Mak
Pays: England
ID NLM: 101088682
Informations de publication
Date de publication:
05 09 2023
05 09 2023
Historique:
received:
09
10
2022
accepted:
27
08
2023
medline:
7
9
2023
pubmed:
6
9
2023
entrez:
5
9
2023
Statut:
epublish
Résumé
Malignant hyperthermia (MH) is a rare anesthetic emergency with a high mortality rate in China. We developed a WeChat applet-based National Remote Emergency System for Malignant Hyperthermia (MH-NRES) to provide a real-time emergency system to help Chinese anesthesiologists deal with MH crises. However, it is imperative that close attention should be paid to the usability of the applet. The objectives of this study were to (1) evaluate the usability of the applet-based MH-NRES for anesthesiologists; and (2) to test the validity and reliability of a modified mHealth app usability questionnaire. A modified User Version of the Mobile Application Rating Scale (uMARS) was designed. Together with System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ), another two well-validated questionnaires, uMARS were then used to evaluate the usability of MH-NRES. The Cronbach alpha of the total score and the subscales of uMARS was calculated to evaluate the internal consistency. The correlation coefficients among three questionnaires were calculated. In this study, 118 anesthesiologists provided responses to the questionnaire. The overall mean uMARS score was 4.43 ± 0.61, which ranged from 3 to 5. The mean PSSUQ score were in good to excellent range with mean of 6.02 ± 0.97, which ranged from 3.19 to 7. The overall SUS score was 76.0 ± 17.6, which ranged from 45 to 100. The total uMARS score had excellent internal consistency (Cronbach alpha = 0.984). uMARS and its subscales were strongly correlated with PSSUQ (coefficient 0.758-0.819, P < 0.001) and SUS (coefficient 0.535-0.561, P < 0.001), respectively. Data obtained from the usability evaluation questionnaires in this study indicated a high quality of the MH-NRES on the ease of use, satisfaction and perceived usefulness, which suggest this system might be a useful tool for anesthesiologists' education and management of MH crises. Future feedback from high-fidelity simulation and clinical scenarios are need for further usability evaluation of this system.
Sections du résumé
BACKGROUND
Malignant hyperthermia (MH) is a rare anesthetic emergency with a high mortality rate in China. We developed a WeChat applet-based National Remote Emergency System for Malignant Hyperthermia (MH-NRES) to provide a real-time emergency system to help Chinese anesthesiologists deal with MH crises. However, it is imperative that close attention should be paid to the usability of the applet.
PURPOSE
The objectives of this study were to (1) evaluate the usability of the applet-based MH-NRES for anesthesiologists; and (2) to test the validity and reliability of a modified mHealth app usability questionnaire.
METHODS
A modified User Version of the Mobile Application Rating Scale (uMARS) was designed. Together with System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ), another two well-validated questionnaires, uMARS were then used to evaluate the usability of MH-NRES. The Cronbach alpha of the total score and the subscales of uMARS was calculated to evaluate the internal consistency. The correlation coefficients among three questionnaires were calculated.
RESULTS
In this study, 118 anesthesiologists provided responses to the questionnaire. The overall mean uMARS score was 4.43 ± 0.61, which ranged from 3 to 5. The mean PSSUQ score were in good to excellent range with mean of 6.02 ± 0.97, which ranged from 3.19 to 7. The overall SUS score was 76.0 ± 17.6, which ranged from 45 to 100. The total uMARS score had excellent internal consistency (Cronbach alpha = 0.984). uMARS and its subscales were strongly correlated with PSSUQ (coefficient 0.758-0.819, P < 0.001) and SUS (coefficient 0.535-0.561, P < 0.001), respectively.
CONCLUSIONS
Data obtained from the usability evaluation questionnaires in this study indicated a high quality of the MH-NRES on the ease of use, satisfaction and perceived usefulness, which suggest this system might be a useful tool for anesthesiologists' education and management of MH crises. Future feedback from high-fidelity simulation and clinical scenarios are need for further usability evaluation of this system.
Identifiants
pubmed: 37670310
doi: 10.1186/s12911-023-02275-4
pii: 10.1186/s12911-023-02275-4
pmc: PMC10478249
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
175Informations de copyright
© 2023. BioMed Central Ltd., part of Springer Nature.
Références
Gong X. Malignant hyperthermia when dantrolene is not readily available. BMC Anesthesiol. 2021;21(1):119.
doi: 10.1186/s12871-021-01328-3
pubmed: 33863282
pmcid: 8051048
Ording H. Incidence of malignant hyperthermia in Denmark. Anesth Analg. 1985;64(7):700–4.
pubmed: 4014731
Yang L, Tautz T, Zhang S, Fomina A, Liu H. The current status of malignant hyperthermia. J Biomed Res. 2019;34(2):75–85.
doi: 10.7555/JBR.33.20180089
pubmed: 32305961
Brandom BW, Bina S, Wong CA, Wallace T, Visoiu M, Isackson PJ, et al. Ryanodine receptor type 1 gene variants in the malignant hyperthermia-susceptible population of the United States. Anesth Analg. 2013;116(5):1078–86.
doi: 10.1213/ANE.0b013e31828a71ff
pubmed: 23558838
pmcid: 3633164
Riazi S, Kraeva N, Hopkins PM. Malignant hyperthermia in the post-genomics era: new perspectives on an old concept. Anesthesiology. 2018;128(1):168–80.
doi: 10.1097/ALN.0000000000001878
pubmed: 28902675
Gonsalves SG, Ng D, Johnston JJ, Teer JK, Stenson PD, Cooper DN, et al. Using exome data to identify malignant hyperthermia susceptibility mutations. Anesthesiology. 2013;119(5):1043–53.
doi: 10.1097/ALN.0b013e3182a8a8e7
pubmed: 24195946
Monnier N, Krivosic-Horber R, Payen J-F, Kozak-Ribbens G, Nivoche Y, Adnet P, et al. Presence of two different genetic traits in malignant hyperthermia families: implication for genetic analysis, diagnosis, and incidence of malignant hyperthermia susceptibility. Anesthesiology. 2002;97(5):1067–74.
doi: 10.1097/00000542-200211000-00007
pubmed: 12411788
Li Z, Liu K, Guo X. Dantrolene available in China for malignant hyperthermia treatment. Anesthesiology. 2022;136:515–6.
doi: 10.1097/ALN.0000000000003998
Hopkins PM, Girard T, Dalay S, Jenkins B, Thacker A, Patteril M, et al. Malignant hyperthermia 2020: guideline from the association of anaesthetists. Anaesthesia. 2021;76(5):655–64.
doi: 10.1111/anae.15317
pubmed: 33399225
Belani KG, Cao C, Daugherty D, Guo X, Hu L, Huang J, et al. Malignant Hyperthermia Status in China: a summary of an international conference. Anesth Analg. 2016;122.
Yu H, Tan L, Teng Y, Xu Z, Xiao K, Yin J, et al. The first National Remote Emergency System for Malignant Hyperthermia (MH-NRES) in China: protocol for the design, development, and evaluation of a WeChat applet. JMIR Res Protoc. 2022;11(6): e37084.
doi: 10.2196/37084
pubmed: 35687418
pmcid: 9233253
Wolf JA, Moreau JF, Akilov O, Patton T, English JC 3rd, Ho J, et al. Diagnostic inaccuracy of smartphone applications for melanoma detection. JAMA Dermatol. 2013;149(4):422–6.
doi: 10.1001/jamadermatol.2013.2382
pubmed: 23325302
pmcid: 4019431
J. B. SUS: A quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland AL, editors Usability Evaluation in Industry London: Taylor and Francis. 1996:189–94.
Lewis, JR. Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies. Int J Humancomputer Interaction. 2002;14(3):463–88.
Zhou L, Bao J, Setiawan IMA, Saptono A, Parmanto B. The mHealth App usability questionnaire (mauq): development and validation study. JMIR Mhealth Uhealth. 2019;7(4): e11500.
doi: 10.2196/11500
pubmed: 30973342
pmcid: 6482399
Brown W 3rd, Yen PY, Rojas M, Schnall R. Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology. J Biomed Inform. 2013;46(6):1080–7.
doi: 10.1016/j.jbi.2013.08.001
pubmed: 23973872
Schnall R, Cho H, Liu J. Health Information Technology Usability Evaluation Scale (Health-ITUES) for usability assessment of mobile health technology: validation study. JMIR Mhealth Uhealth. 2018;6(1): e4.
doi: 10.2196/mhealth.8851
pubmed: 29305343
pmcid: 5775483
Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1): e27.
doi: 10.2196/mhealth.3422
pubmed: 25760773
pmcid: 4376132
Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. 2016;4(2): e72.
doi: 10.2196/mhealth.5849
pubmed: 27287964
pmcid: 4920963
Measuring usability with the System Usability Scale (SUS). MeasuringU. https://measuringu.com/sis/ . Accessed 23 Aug 2018.
Bangor AKP, Miller JT. An empirical evaluation of the system usability scale. Int J Human Comput Interact. 2008;24(6):574–94.
doi: 10.1080/10447310802205776
Landauer T. Behavioral research methods in human-computer interaction. In: Helander M, Landauer TK, Prabhu P, editors. Handbook of Human-Computer Interaction. 2nd ed. Amsterdam, Netherlands: Elsevier Inc; 1997. p. 203–27.
doi: 10.1016/B978-044481862-1.50075-3
William HD, Ephraim RM. The DeLone and McLean model of information systems success: a ten-year update. J Manag Inform Syst. 2003;19(4):9–30.
Wu B. Patient continued use of online health care communities: web mining of patient-doctor communication. J Med Internet Res. 2018;20(4).
doi: 10.2196/jmir.9127
pubmed: 29661747
pmcid: 5928330
Alsabawy AY, Cater-Steel A, Soar J. Determinants of perceived usefulness of e-learning systems. Comput Human Behav. 2016;64:843–58.
Gelderman M. The relation between user satisfaction, usage of information systems and performance. Inform Manag. 1998;34(1):11–8.
Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model. MIS Q. 2001;25(3):351–70.
doi: 10.2307/3250921
Teferi GH, Tilahun BC, Guadie HA, Amare AT. Smartphone medical app use and associated factors among physicians at referral hospitals in Amhara Region, North Ethiopia, in 2019: cross-sectional study. JMIR Mhealth Uhealth. 2021;9(3): e19310.
doi: 10.2196/19310
pubmed: 33769303
pmcid: 8096376
Song T, Deng N, Cui T, Qian S, Liu F, Guan Y, et al. Measuring success of patients’ continuous use of mobile health services for self-management of chronic conditions: model development and validation. J Med Internet Res. 2021;23(7): e26670.
doi: 10.2196/26670
pubmed: 34255685
pmcid: 8317034
Dittrich F, Back DA, Harren AK, Jäger M, Landgraeber S, Reinecke F, et al. A possible mobile health solution in orthopedics and trauma surgery: development protocol and user evaluation of the ankle joint app. JMIR Mhealth Uhealth. 2020;8(2): e16403.
doi: 10.2196/16403
pubmed: 32130171
pmcid: 7066508
Soomro N, Chhaya M, Soomro M, Asif N, Saurman E, Lyle D, et al. Design, development, and evaluation of an injury surveillance app for cricket: protocol and qualitative study. JMIR Mhealth Uhealth. 2019;7(1): e10978.
doi: 10.2196/10978
pubmed: 30668516
pmcid: 6362388
Shahmoradi L, Azizpour A, Bejani M, Shadpour P, Rezayi S. Prevention and control of urinary tract stones using a smartphone-based self-care application: design and evaluation. BMC Med Inform Decis Mak. 2021;21(1):299.
doi: 10.1186/s12911-021-01661-0
pubmed: 34724936
pmcid: 8559363