Assessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients.

Artificial intelligence COVID-19 Z-Inspection® case study ethical tradeoff ethics explainable AI healthcare pandemic radiology trust trustworthy AI

Journal

IEEE transactions on technology and society
ISSN: 2637-6415
Titre abrégé: IEEE Trans Technol Soc
Pays: United States
ID NLM: 9918367888706676

Informations de publication

Date de publication:
Dec 2022
Historique:
received: 08 12 2021
revised: 13 07 2022
accepted: 18 07 2022
entrez: 27 12 2022
pubmed: 28 12 2022
medline: 28 12 2022
Statut: epublish

Résumé

This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert Group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does "trustworthy AI" mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic.

Identifiants

pubmed: 36573115
doi: 10.1109/TTS.2022.3195114
pmc: PMC9762021
doi:

Types de publication

Journal Article

Langues

eng

Pagination

272-289

Références

Med Image Anal. 2021 Jul;71:102046
pubmed: 33862337
N Engl J Med. 2020 Aug 6;383(6):590-592
pubmed: 32402155
Radiology. 2019 Nov;293(2):436-440
pubmed: 31573399
Can J Kidney Health Dis. 2020 Jul 07;7:2054358120938573
pubmed: 32685180
Nature. 2021 Aug 3;:
pubmed: 34345037
AI Soc. 2020;35(3):761-765
pubmed: 32346223
Deep Learn Med Image Anal Multimodal Learn Clin Decis Support (2018). 2018 Sep;11045:3-11
pubmed: 32613207
Sci Eng Ethics. 2021 Jul 6;27(4):44
pubmed: 34231029
Hum Behav Emerg Technol. 2021 Jan;3(1):25-39
pubmed: 33363278
Radiology. 2018 Mar;286(3):800-809
pubmed: 29309734
Disaster Med Public Health Prep. 2022 Feb;16(1):333-340
pubmed: 33004102
Radiology. 2021 Mar;298(3):E162-E164
pubmed: 33350895
Int J Infect Dis. 2020 Jul;96:291-293
pubmed: 32437939

Auteurs

Himanshi Allahabadi (H)

Enterprise Intelligence DepartmentEY Netherlands 1083 HP Amsterdam The Netherlands.

Julia Amann (J)

Health Ethics and Policy LabDepartment of Health Sciences and TechnologyETH Zurich 8092 Zürich Switzerland.

Isabelle Balot (I)

Postgraduate Studies in Diplomacy and International RelationsCenter for Diplomatic & Strategic Studies 75015 Paris France.

Andrea Beretta (A)

Institute of Information Science and Technologies, National Research Council of Italy (CNR) 56124 Pisa Italy.

Charles Binkley (C)

Bioethics CenterHackensack Meridian Health Edison NJ 08820 USA.

Jonas Bozenhard (J)

Faculty of PhilosophyUniversity of Oxford Oxford OX2 6GG U.K.

Frederick Bruneault (F)

Philosophie DepartmentCollège André- Laurendeau Montreal QC H8N 2J4 Canada.
École des médiasUniversité du Québec à Montréal Montreal QC H2L 2C4 Canada.

James Brusseau (J)

Philosophy DepartmentPace University New York NY 10038 USA.

Sema Candemir (S)

Wexner Medical CenterDepartment of RadiologyThe Ohio State University Columbus OH 43210 USA.

Luca Alessandro Cappellini (LA)

Department of RadiologyHumanitas Research Hospital 20089 Milan Italy.
Department of Biomedical SciencesHumanitas University 20089 Milan Italy.

Subrata Chakraborty (S)

Faculty of Science, Agriculture, Business and LawUniversity of New England Armidale NSW 2351 Australia.
Faculty of Engineering and Information TechnologyUniversity of Technology Sydney Sydney NSW 2007 Australia.

Nicoleta Cherciu (N)

European Centre of Excellence on the Regulation of Robotics & AIScuola Superiore Sant'Anna 56127 Pisa Italy.

Christina Cociancig (C)

Group of Computer ArchitectureUniversity of Bremen 28359 Bremen Germany.

Megan Coffee (M)

Department of MedicineDivision of Infectious Diseases and ImmunologyNew York University Grossman School of Medicine New York NY 10016 USA.

Irene Ek (I)

AI Research SectionDigital Institute 16731 Stockholm Sweden.

Leonardo Espinosa-Leal (L)

Department of Business Management and AnalyticsArcada University of Applied Sciences 00550 Helsinki Finland.

Davide Farina (D)

Department of Medical and Surgical SpecialtiesRadiological Sciences, and Public HealthUniversity of Brescia 25121 Brescia Italy.

Genevieve Fieux-Castagnet (G)

Ethique GroupeSNCF Reseau SA 93418 La Plaine France.

Thomas Frauenfelder (T)

Institute of Diagnostic and Interventional Radiology, University Hospital Zurich 8091 Zürich Switzerland.

Alessio Gallucci (A)

Department of Mathematics and Computer ScienceEindhoven University of Technology 5600 MB Eindhoven The Netherlands.

Guya Giuliani (G)

Data Privacy Advisor, Ericsson 11331 Stockholm Sweden.

Adam Golda (A)

Department of Cardiology4th Gliwice Municipal Hospital 44-100 Gliwice Poland.

Irmhild van Halem (I)

Z-Inspection® Initiative Frankfurt Germany.

Elisabeth Hildt (E)

Center for the Study of Ethics in the ProfessionsIllinois Institute of Technology Chicago IL 60616 USA.

Sune Holm (S)

Department of Food and Resource EconomicsUniversity of Copenhagen 1165 Copenhagen Denmark.

Georgios Kararigas (G)

Department of PhysiologyFaculty of MedicineUniversity of Iceland 101 Reykjavik Iceland.

Sebastien A Krier (SA)

Cyber Policy CenterStanford University Stanford CA 94305 USA.

Ulrich Kuhne (U)

Department for DermatologyHautmedizin Bad Soden 65812 Bad Soden Germany.

Francesca Lizzi (F)

Data Science DepartmentScuola Normale Superiore 56126 Pisa Italy.

Vince I Madai (VI)

Charité Lab for Artificial Intelligence in MedicineDepartment of Neurosurgery, the QUEST Centre for Responsible ResearchBerlin Institute of Health at Charité, Charité Universitätsmedizin Berlin 10117 Berlin Germany.
Faculty of Computing, Engineering and the Built Environment, School of Computing and Digital TechnologyBirmingham City University Birmingham B4 7XG U.K.

Aniek F Markus (AF)

Department of Medical InformaticsErasmus University Medical Center 3015 GD Rotterdam The Netherlands.

Serg Masis (S)

CADS DepartmentSyngenta Research Triangle Park NC 27709 USA.

Emilie Wiinblad Mathez (EW)

Z-Inspection® Initiative Frankfurt Germany.

Francesco Mureddu (F)

Policy ResearchThe Lisbon Council 1040 Brussels Belgium.

Emanuele Neri (E)

Department of Translational ResearchAcademic RadiologyUniversity of Pisa 56126 Pisa Italy.

Walter Osika (W)

Center for Psychiatry ResearchDepartment of Clinical NeuroscienceKarolinska Institutet 171 77 Stockholm Sweden.

Matiss Ozols (M)

Department of MedicineThe University of Cambridge, Addenbrooke's Hospital Cambridge CB2 0QQ U.K.
School of Cell Matrix and Regenerative MedicineThe University of Manchester Manchester M13 9PG U.K.
Department of Human GeneticsThe Wellcome Sanger Institute, Wellcome Genome Campus Cambridge CB10 1RQ U.K.

Cecilia Panigutti (C)

Department of Computer ScienceUniversity of Pisa 56127 Pisa Italy.

Brendan Parent (B)

Division of Medical EthicsDepartment of Population HealthNYU Grossman School of Medicine New York NY 10016 USA.

Francesca Pratesi (F)

Institute of Information Science and Technologies, National Research Council of Italy (CNR) 56124 Pisa Italy.

Pedro A Moreno-Sanchez (PA)

School of Healthcare and Social WorkSeinäjoki University of Applied Sciences 60100 Seinäjoki Finland.

Giovanni Sartor (G)

Law DepartmentEuropean University Institute 50139 Firenze Italy.
CIRSFID-Alma AI and Law DepartmentUniversity of Bologna 40121 Bologna Italy.

Mattia Savardi (M)

Department of Information EngineeringUniversity of Brescia 25121 Brescia Italy.

Alberto Signoroni (A)

Department of Information EngineeringUniversity of Brescia 25121 Brescia Italy.

Hanna-Maria Sormunen (HM)

Advanced AnalyticsFinnish Tax Administration 00510 Helsinki Finland.

Andy Spezzatti (A)

Artificial Intelligence ResearchAI for Good Foundation El Cerrito CA 94530 USA.
Industrial Engineering and Operation Research DepartmentUniversity of California at Berkeley Berkeley CA 94720 USA.

Adarsh Srivastava (A)

Data Services Function in Roche Diagnostics, Roche Pune 411005 India.

Annette F Stephansen (AF)

Digital SystemsNORCE Norwegian Research Centre AS 5008 Bergen Norway.

Lau Bee Theng (LB)

School of ResearchSwinburne University of Technology (Sarawak) Kuching 93350 Malaysia.

Jesmin Jahan Tithi (JJ)

Parallel Computing Labs, Intel Santa Clara CA 95054 USA.
Department of Computer ScienceStony Brook University Stony Brook NY 11794 USA.

Jarno Tuominen (J)

Department of Psychology and Speech- Language PathologyUniversity of Turku 20500 Turku Finland.

Steven Umbrello (S)

Department of ValuesTechnology and InnovationDelft University of Technology 2628 BX Delft The Netherlands.

Filippo Vaccher (F)

Department of Medical and Surgical SpecialtiesRadiological Sciences, and Public HealthUniversity of Brescia 25121 Brescia Italy.

Dennis Vetter (D)

Computational Vision and Artificial Intelligence LabGoethe University Frankfurt 60325 Frankfurt Germany.

Magnus Westerlund (M)

Department of Business Management and AnalyticsArcada University of Applied Sciences 00550 Helsinki Finland.
School of Economics, Innovation and TechnologyKristiania University College 0107 Olso Norway.

Renee Wurth (R)

T. H. Chan School of Public HealthHarvard University Boston MA 02115 USA.

Roberto V Zicari (RV)

Department of Business Management and AnalyticsArcada University of Applied Sciences 00550 Helsinki Finland.
Data Science Graduate SchoolSeoul National University Seoul 08826 South Korea.

Classifications MeSH