Proposal of a New Rating Concept for Digital Health Applications in Orthopedics and Traumatology.
health-related apps
healthcare certification
mHealth
orthopedic society
patient safety
quality standard
telemedicine
Journal
International journal of environmental research and public health
ISSN: 1660-4601
Titre abrégé: Int J Environ Res Public Health
Pays: Switzerland
ID NLM: 101238455
Informations de publication
Date de publication:
13 11 2022
13 11 2022
Historique:
received:
30
08
2022
revised:
29
10
2022
accepted:
11
11
2022
entrez:
26
11
2022
pubmed:
27
11
2022
medline:
30
11
2022
Statut:
epublish
Résumé
Health-related mobile applications (apps) are rapidly increasing in number. There is an urgent need for assessment tools and algorithms that allow the usability and content criteria of these applications to be objectively assessed. The aim of this work was to establish and validate a concept for orthopedic societies to rate health apps to set a quality standard for their safe use. An objective rating concept was created, consisting of nine quality criteria. A self-declaration sheet for app manufacturers was designed. Manufacturers completed the self-declaration, and the app was examined by independent internal reviewers. The pilot validation and analysis were performed on two independent health applications. An algorithm for orthopedic societies was created based on the experiences in this study flow. "Sprunggelenks-App" was approved by the reviewers with 45 (98%) fulfilled criteria and one (2%) unfulfilled criterion. "Therapie-App" was approved, with 28 (61%) met criteria, 6 (13%) unfulfilled criteria and 12 (26%) criteria that could not be assessed. The self-declaration completed by the app manufacturer is recommended, followed by a legal and technical rating performed by an external institution. When rated positive, the societies' internal review using independent raters can be performed. In case of a positive rating, a visual certification can be granted to the manufacturer for a certain time frame. An objective rating algorithm is proposed for the assessment of digital health applications. This can help societies to improve the quality assessment, quality assurance and patient safety of those apps. The proposed concept must be further validated for inter-rater consistency and reliability.
Sections du résumé
BACKGROUND
Health-related mobile applications (apps) are rapidly increasing in number. There is an urgent need for assessment tools and algorithms that allow the usability and content criteria of these applications to be objectively assessed. The aim of this work was to establish and validate a concept for orthopedic societies to rate health apps to set a quality standard for their safe use.
METHODS
An objective rating concept was created, consisting of nine quality criteria. A self-declaration sheet for app manufacturers was designed. Manufacturers completed the self-declaration, and the app was examined by independent internal reviewers. The pilot validation and analysis were performed on two independent health applications. An algorithm for orthopedic societies was created based on the experiences in this study flow.
RESULTS
"Sprunggelenks-App" was approved by the reviewers with 45 (98%) fulfilled criteria and one (2%) unfulfilled criterion. "Therapie-App" was approved, with 28 (61%) met criteria, 6 (13%) unfulfilled criteria and 12 (26%) criteria that could not be assessed. The self-declaration completed by the app manufacturer is recommended, followed by a legal and technical rating performed by an external institution. When rated positive, the societies' internal review using independent raters can be performed. In case of a positive rating, a visual certification can be granted to the manufacturer for a certain time frame.
CONCLUSION
An objective rating algorithm is proposed for the assessment of digital health applications. This can help societies to improve the quality assessment, quality assurance and patient safety of those apps. The proposed concept must be further validated for inter-rater consistency and reliability.
Identifiants
pubmed: 36429670
pii: ijerph192214952
doi: 10.3390/ijerph192214952
pmc: PMC9690508
pii:
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Références
BMC Med. 2018 Dec 3;16(1):225
pubmed: 30501638
Appl Clin Inform. 2017 Aug 16;8(3):832-844
pubmed: 28885637
J Tissue Viability. 1999 Jan;9(1):11-5
pubmed: 10480978
J Am Med Inform Assoc. 2021 Sep 18;28(10):2074-2084
pubmed: 34338763
NPJ Digit Med. 2019 May 3;2:34
pubmed: 31304380
JMIR Mhealth Uhealth. 2016 Jun 10;4(2):e72
pubmed: 27287964
BMJ. 2015 Nov 04;351:h5915
pubmed: 26536895
JMIR Mhealth Uhealth. 2015 Mar 11;3(1):e27
pubmed: 25760773
Am J Med. 2016 Jan;129(1):11-9
pubmed: 26091764
JMIR Mhealth Uhealth. 2020 Mar 27;8(3):e14479
pubmed: 32217504
Int J Environ Res Public Health. 2020 Feb 18;17(4):
pubmed: 32085422
Evid Based Ment Health. 2018 Aug;21(3):116-119
pubmed: 29871870
Lancet Digit Health. 2019 Jun;1(2):e52-e54
pubmed: 33323229
J Med Internet Res. 2014 Sep 15;16(9):e210
pubmed: 25223398
JMIR Mhealth Uhealth. 2019 Nov 18;7(11):e16442
pubmed: 31738179
JMIR Mhealth Uhealth. 2015 Nov 04;3(4):e101
pubmed: 26537656
Health Aff (Millwood). 2016 Dec 1;35(12):2310-2318
pubmed: 27920321
BMC Surg. 2020 Oct 7;20(1):229
pubmed: 33028309
Injury. 2021 Nov;52(11):3304-3308
pubmed: 33648741
J Am Med Inform Assoc. 2018 Aug 1;25(8):1089-1098
pubmed: 29788283
Injury. 2018 May;49(5):945-952
pubmed: 29525105
JMIR Mhealth Uhealth. 2022 Jan 11;10(1):e26563
pubmed: 35014965
J Bone Joint Surg Am. 2017 Sep 6;99(17):e93
pubmed: 28872535
BMC Sports Sci Med Rehabil. 2015 Oct 12;7:23
pubmed: 26464800
Digit Health. 2019 Oct 10;5:2055207619882181
pubmed: 31656632
Explore (NY). 2011 Jul-Aug;7(4):256-61
pubmed: 21724160
JMIR Mhealth Uhealth. 2019 Feb 27;7(2):e13375
pubmed: 30810534
Healthc Inform Res. 2018 Jul;24(3):207-226
pubmed: 30109154
Pediatrics. 2017 May;139(5):
pubmed: 28557762
Internet Interv. 2021 Mar 17;24:100379
pubmed: 33777705
JMIR Mhealth Uhealth. 2018 Apr 25;6(4):e10394
pubmed: 29695374
Front Digit Health. 2022 Feb 17;4:765993
pubmed: 35252957