A deep learning-based algorithm improves radiology residents' diagnoses of acute pulmonary embolism on CT pulmonary angiograms.

CT angiography Deep learning Medical education Pulmonary embolism Radiology residents

Journal

European journal of radiology
ISSN: 1872-7727
Titre abrégé: Eur J Radiol
Pays: Ireland
ID NLM: 8106411

Informations de publication

Date de publication:
17 Jan 2024
Historique:
received: 03 10 2023
revised: 08 12 2023
accepted: 15 01 2024
medline: 20 1 2024
pubmed: 20 1 2024
entrez: 19 1 2024
Statut: aheadofprint

Résumé

To compare radiology residents' diagnostic performances to detect pulmonary emboli (PEs) on CT pulmonary angiographies (CTPAs) with deep-learning (DL)-based algorithm support and without. Fully anonymized CTPAs (n = 207) of patients suspected of having acute PE served as input for PE detection using a previously trained and validated DL-based algorithm. Three residents in their first three years of training, blinded to the index report and clinical history, read the CTPAs first without, and 2 months later with the help of artificial intelligence (AI) output, to diagnose PE as present, absent or indeterminate. We evaluated concordances and discordances with the consensus-reading results of two experts in chest imaging. Because the AI algorithm failed to analyze 11 CTPAs, 196 CTPAs were analyzed; 31 (15.8 %) were PE-positive. Good-classification performance was higher for residents with AI-algorithm support than without (AUROCs: 0.958 [95 % CI: 0.921-0.979] vs. 0.894 [95 % CI: 0.850-0.931], p < 0.001, respectively). The main finding was the increased sensitivity of residents' diagnoses using the AI algorithm (92.5 % vs. 81.7 %, respectively). Concordance between residents (kappa: 0.77 [95 % CI: 0.76-0.78]; p < 0.001) improved with AI-algorithm use (kappa: 0.88 [95 % CI: 0.87-0.89]; p < 0.001). The AI algorithm we used improved between-resident agreements to interpret CTPAs for suspected PE and, hence, their diagnostic performances.

Identifiants

pubmed: 38241853
pii: S0720-048X(24)00040-8
doi: 10.1016/j.ejrad.2024.111324
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

111324

Informations de copyright

Copyright © 2024 Elsevier B.V. All rights reserved.

Déclaration de conflit d'intérêts

Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Auteurs

Alexandre Vallée (A)

Department of Epidemiology and Public Health, Hôpital Foch. 40 rue Worth 92150 Suresnes, France. Electronic address: al.vallee@hopital-foch.com.

Raphaelle Quint (R)

Department of Medical Imaging, Hôpital Foch. 40 rue Worth 92150 Suresnes, France. Electronic address: r.quint@hopital-foch.com.

Anne Laure Brun (A)

Department of Medical Imaging, Hôpital Foch. 40 rue Worth 92150 Suresnes, France. Electronic address: al.brun@hopital-foch.com.

François Mellot (F)

Department of Medical Imaging, Hôpital Foch. 40 rue Worth 92150 Suresnes, France. Electronic address: f.mellot@hopital-foch.org.

Philippe A Grenier (PA)

Department of Clinical Research and Innovation, Hôpital Foch. 40 rue Worth 92150 Suresnes, France. Electronic address: p.grenier@hopital-foch.com.

Classifications MeSH