Exploring Stakeholder Requirements to Enable Research and Development of Artificial Intelligence Algorithms in a Hospital-Based Generic Infrastructure: Results of a Multistep Mixed Methods Study.
artificial intelligence
data availability
mixed-methods
qualitative research
requirements analysis
Journal
JMIR formative research
ISSN: 2561-326X
Titre abrégé: JMIR Form Res
Pays: Canada
ID NLM: 101726394
Informations de publication
Date de publication:
18 Apr 2023
18 Apr 2023
Historique:
received:
31
10
2022
accepted:
22
02
2023
revised:
29
01
2023
medline:
19
4
2023
entrez:
18
4
2023
pubmed:
19
4
2023
Statut:
epublish
Résumé
Legal, controlled, and regulated access to high-quality data from academic hospitals currently poses a barrier to the development and testing of new artificial intelligence (AI) algorithms. To overcome this barrier, the German Federal Ministry of Health supports the "pAItient" (Protected Artificial Intelligence Innovation Environment for Patient Oriented Digital Health Solutions for developing, testing and evidence-based evaluation of clinical value) project, with the goal to establish an AI Innovation Environment at the Heidelberg University Hospital, Germany. It is designed as a proof-of-concept extension to the preexisting Medical Data Integration Center. The first part of the pAItient project aims to explore stakeholders' requirements for developing AI in partnership with an academic hospital and granting AI experts access to anonymized personal health data. We designed a multistep mixed methods approach. First, researchers and employees from stakeholder organizations were invited to participate in semistructured interviews. In the following step, questionnaires were developed based on the participants' answers and distributed among the stakeholders' organizations. In addition, patients and physicians were interviewed. The identified requirements covered a wide range and were conflicting sometimes. Relevant patient requirements included adequate provision of necessary information for data use, clear medical objective of the research and development activities, trustworthiness of the organization collecting the patient data, and data should not be reidentifiable. Requirements of AI researchers and developers encompassed contact with clinical users, an acceptable user interface (UI) for shared data platforms, stable connection to the planned infrastructure, relevant use cases, and assistance in dealing with data privacy regulations. In a next step, a requirements model was developed, which depicts the identified requirements in different layers. This developed model will be used to communicate stakeholder requirements within the pAItient project consortium. The study led to the identification of necessary requirements for the development, testing, and validation of AI applications within a hospital-based generic infrastructure. A requirements model was developed, which will inform the next steps in the development of an AI innovation environment at our institution. Results from our study replicate previous findings from other contexts and will add to the emerging discussion on the use of routine medical data for the development of AI applications. RR2-10.2196/42208.
Sections du résumé
BACKGROUND
BACKGROUND
Legal, controlled, and regulated access to high-quality data from academic hospitals currently poses a barrier to the development and testing of new artificial intelligence (AI) algorithms. To overcome this barrier, the German Federal Ministry of Health supports the "pAItient" (Protected Artificial Intelligence Innovation Environment for Patient Oriented Digital Health Solutions for developing, testing and evidence-based evaluation of clinical value) project, with the goal to establish an AI Innovation Environment at the Heidelberg University Hospital, Germany. It is designed as a proof-of-concept extension to the preexisting Medical Data Integration Center.
OBJECTIVE
OBJECTIVE
The first part of the pAItient project aims to explore stakeholders' requirements for developing AI in partnership with an academic hospital and granting AI experts access to anonymized personal health data.
METHODS
METHODS
We designed a multistep mixed methods approach. First, researchers and employees from stakeholder organizations were invited to participate in semistructured interviews. In the following step, questionnaires were developed based on the participants' answers and distributed among the stakeholders' organizations. In addition, patients and physicians were interviewed.
RESULTS
RESULTS
The identified requirements covered a wide range and were conflicting sometimes. Relevant patient requirements included adequate provision of necessary information for data use, clear medical objective of the research and development activities, trustworthiness of the organization collecting the patient data, and data should not be reidentifiable. Requirements of AI researchers and developers encompassed contact with clinical users, an acceptable user interface (UI) for shared data platforms, stable connection to the planned infrastructure, relevant use cases, and assistance in dealing with data privacy regulations. In a next step, a requirements model was developed, which depicts the identified requirements in different layers. This developed model will be used to communicate stakeholder requirements within the pAItient project consortium.
CONCLUSIONS
CONCLUSIONS
The study led to the identification of necessary requirements for the development, testing, and validation of AI applications within a hospital-based generic infrastructure. A requirements model was developed, which will inform the next steps in the development of an AI innovation environment at our institution. Results from our study replicate previous findings from other contexts and will add to the emerging discussion on the use of routine medical data for the development of AI applications.
INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)
UNASSIGNED
RR2-10.2196/42208.
Identifiants
pubmed: 37071450
pii: v7i1e43958
doi: 10.2196/43958
pmc: PMC10155093
doi:
Types de publication
Journal Article
Langues
eng
Pagination
e43958Informations de copyright
©Lina Weinert, Maximilian Klass, Gerd Schneider, Oliver Heinze. Originally published in JMIR Formative Research (https://formative.jmir.org), 18.04.2023.
Références
BMC Med Ethics. 2008 Nov 19;9:18
pubmed: 19019239
BMC Health Serv Res. 2018 Jul 13;18(1):545
pubmed: 30001717
J Med Internet Res. 2019 Jul 10;21(7):e13659
pubmed: 31293245
J Med Internet Res. 2021 Apr 22;23(4):e25759
pubmed: 33885365
Digit Health. 2022 Aug 8;8:20552076221116772
pubmed: 35983102
JMIR Med Inform. 2022 Jun 15;10(6):e34678
pubmed: 35704378
Int J Qual Health Care. 2007 Dec;19(6):349-57
pubmed: 17872937
CMAJ Open. 2019 Feb 3;7(1):E40-E46
pubmed: 30718354
JAMA Netw Open. 2019 Aug 2;2(8):e199550
pubmed: 31433479
Eur Radiol. 2020 Oct;30(10):5510-5524
pubmed: 32377810
Am J Med. 2019 Jul;132(7):795-801
pubmed: 30710543
J Biomed Inform. 2009 Apr;42(2):377-81
pubmed: 18929686
BMJ Open. 2020 Oct 28;10(10):e039798
pubmed: 33115901
BMC Med Ethics. 2016 Nov 10;17(1):73
pubmed: 27832780
Front Oncol. 2022 Feb 24;12:742701
pubmed: 35280732
BMC Med Ethics. 2021 Mar 24;22(1):29
pubmed: 33761938
JMIR Form Res. 2022 May 18;6(5):e35367
pubmed: 35583921
Res Involv Engagem. 2017 Aug 2;3:13
pubmed: 29062538
JMIR Res Protoc. 2022 Dec 16;11(12):e42208
pubmed: 36525300
J Med Internet Res. 2021 Dec 13;23(12):e26611
pubmed: 34898454
Nat Med. 2019 Jan;25(1):30-36
pubmed: 30617336
Eur Radiol. 2020 Oct;30(10):5525-5532
pubmed: 32458173
NPJ Digit Med. 2022 Jun 2;5(1):67
pubmed: 35654885
CMAJ Open. 2020 Feb 18;8(1):E90-E95
pubmed: 32071143
J Biomed Inform. 2019 Jul;95:103208
pubmed: 31078660
Mach Learn. 2021;110(1):1-14
pubmed: 33318723
Stud Health Technol Inform. 2021 Sep 21;283:111-118
pubmed: 34545826
J Am Med Inform Assoc. 2020 Mar 1;27(3):491-497
pubmed: 31682262
Lancet. 2020 May 16;395(10236):1579-1586
pubmed: 32416782