Collaborative strategies for deploying artificial intelligence to complement physician diagnoses of acute respiratory distress syndrome.
Journal
NPJ digital medicine
ISSN: 2398-6352
Titre abrégé: NPJ Digit Med
Pays: England
ID NLM: 101731738
Informations de publication
Date de publication:
08 Apr 2023
08 Apr 2023
Historique:
received:
08
09
2022
accepted:
10
03
2023
medline:
9
4
2023
entrez:
8
4
2023
pubmed:
9
4
2023
Statut:
epublish
Résumé
There is a growing gap between studies describing the capabilities of artificial intelligence (AI) diagnostic systems using deep learning versus efforts to investigate how or when to integrate AI systems into a real-world clinical practice to support physicians and improve diagnosis. To address this gap, we investigate four potential strategies for AI model deployment and physician collaboration to determine their potential impact on diagnostic accuracy. As a case study, we examine an AI model trained to identify findings of the acute respiratory distress syndrome (ARDS) on chest X-ray images. While this model outperforms physicians at identifying findings of ARDS, there are several reasons why fully automated ARDS detection may not be optimal nor feasible in practice. Among several collaboration strategies tested, we find that if the AI model first reviews the chest X-ray and defers to a physician if it is uncertain, this strategy achieves a higher diagnostic accuracy (0.869, 95% CI 0.835-0.903) compared to a strategy where a physician reviews a chest X-ray first and defers to an AI model if uncertain (0.824, 95% CI 0.781-0.862), or strategies where the physician reviews the chest X-ray alone (0.808, 95% CI 0.767-0.85) or the AI model reviews the chest X-ray alone (0.847, 95% CI 0.806-0.887). If the AI model reviews a chest X-ray first, this allows the AI system to make decisions for up to 79% of cases, letting physicians focus on the most challenging subsets of chest X-rays.
Identifiants
pubmed: 37031252
doi: 10.1038/s41746-023-00797-9
pii: 10.1038/s41746-023-00797-9
pmc: PMC10082784
doi:
Types de publication
Journal Article
Langues
eng
Pagination
62Informations de copyright
© 2023. The Author(s).
Références
JAMA Netw Open. 2021 Dec 1;4(12):e2141096
pubmed: 34964851
Nat Med. 2020 Aug;26(8):1229-1234
pubmed: 32572267
NPJ Digit Med. 2021 Jan 8;4(1):5
pubmed: 33420381
J Am Med Inform Assoc. 2020 Apr 1;27(4):621-633
pubmed: 32106284
IEEE J Biomed Health Inform. 2019 Jan;23(1):407-415
pubmed: 29994592
Lancet Digit Health. 2021 Jun;3(6):e340-e348
pubmed: 33893070
BMC Pulm Med. 2019 Feb 11;19(1):37
pubmed: 30744598
Intensive Care Med. 2012 Oct;38(10):1573-82
pubmed: 22926653
N Engl J Med. 2005 Oct 20;353(16):1685-93
pubmed: 16236739
Nat Med. 2019 Jan;25(1):44-56
pubmed: 30617339
Acta Ophthalmol. 2013 Aug;91(5):413-7
pubmed: 22583841
Chest. 2018 Feb;153(2):361-367
pubmed: 29248620
PLoS Med. 2018 Nov 27;15(11):e1002699
pubmed: 30481176
JAMA. 2016 Feb 23;315(8):788-800
pubmed: 26903337
Nat Med. 2019 Jan;25(1):65-69
pubmed: 30617320
N Engl J Med. 2000 May 4;342(18):1334-49
pubmed: 10793167
NPJ Digit Med. 2020 Sep 9;3:115
pubmed: 32964138
JAMA. 2012 Jun 20;307(23):2526-33
pubmed: 22797452