A deep learning-based application for COVID-19 diagnosis on CT: The Imaging COVID-19 AI initiative.
Journal
PloS one
ISSN: 1932-6203
Titre abrégé: PLoS One
Pays: United States
ID NLM: 101285081
Informations de publication
Date de publication:
2023
2023
Historique:
received:
26
01
2023
accepted:
15
04
2023
medline:
4
5
2023
pubmed:
2
5
2023
entrez:
2
5
2023
Statut:
epublish
Résumé
Recently, artificial intelligence (AI)-based applications for chest imaging have emerged as potential tools to assist clinicians in the diagnosis and management of patients with coronavirus disease 2019 (COVID-19). To develop a deep learning-based clinical decision support system for automatic diagnosis of COVID-19 on chest CT scans. Secondarily, to develop a complementary segmentation tool to assess the extent of lung involvement and measure disease severity. The Imaging COVID-19 AI initiative was formed to conduct a retrospective multicentre cohort study including 20 institutions from seven different European countries. Patients with suspected or known COVID-19 who underwent a chest CT were included. The dataset was split on the institution-level to allow external evaluation. Data annotation was performed by 34 radiologists/radiology residents and included quality control measures. A multi-class classification model was created using a custom 3D convolutional neural network. For the segmentation task, a UNET-like architecture with a backbone Residual Network (ResNet-34) was selected. A total of 2,802 CT scans were included (2,667 unique patients, mean [standard deviation] age = 64.6 [16.2] years, male/female ratio 1.3:1). The distribution of classes (COVID-19/Other type of pulmonary infection/No imaging signs of infection) was 1,490 (53.2%), 402 (14.3%), and 910 (32.5%), respectively. On the external test dataset, the diagnostic multiclassification model yielded high micro-average and macro-average AUC values (0.93 and 0.91, respectively). The model provided the likelihood of COVID-19 vs other cases with a sensitivity of 87% and a specificity of 94%. The segmentation performance was moderate with Dice similarity coefficient (DSC) of 0.59. An imaging analysis pipeline was developed that returned a quantitative report to the user. We developed a deep learning-based clinical decision support system that could become an efficient concurrent reading tool to assist clinicians, utilising a newly created European dataset including more than 2,800 CT scans.
Sections du résumé
BACKGROUND
Recently, artificial intelligence (AI)-based applications for chest imaging have emerged as potential tools to assist clinicians in the diagnosis and management of patients with coronavirus disease 2019 (COVID-19).
OBJECTIVES
To develop a deep learning-based clinical decision support system for automatic diagnosis of COVID-19 on chest CT scans. Secondarily, to develop a complementary segmentation tool to assess the extent of lung involvement and measure disease severity.
METHODS
The Imaging COVID-19 AI initiative was formed to conduct a retrospective multicentre cohort study including 20 institutions from seven different European countries. Patients with suspected or known COVID-19 who underwent a chest CT were included. The dataset was split on the institution-level to allow external evaluation. Data annotation was performed by 34 radiologists/radiology residents and included quality control measures. A multi-class classification model was created using a custom 3D convolutional neural network. For the segmentation task, a UNET-like architecture with a backbone Residual Network (ResNet-34) was selected.
RESULTS
A total of 2,802 CT scans were included (2,667 unique patients, mean [standard deviation] age = 64.6 [16.2] years, male/female ratio 1.3:1). The distribution of classes (COVID-19/Other type of pulmonary infection/No imaging signs of infection) was 1,490 (53.2%), 402 (14.3%), and 910 (32.5%), respectively. On the external test dataset, the diagnostic multiclassification model yielded high micro-average and macro-average AUC values (0.93 and 0.91, respectively). The model provided the likelihood of COVID-19 vs other cases with a sensitivity of 87% and a specificity of 94%. The segmentation performance was moderate with Dice similarity coefficient (DSC) of 0.59. An imaging analysis pipeline was developed that returned a quantitative report to the user.
CONCLUSION
We developed a deep learning-based clinical decision support system that could become an efficient concurrent reading tool to assist clinicians, utilising a newly created European dataset including more than 2,800 CT scans.
Identifiants
pubmed: 37130128
doi: 10.1371/journal.pone.0285121
pii: PONE-D-23-02337
pmc: PMC10153726
doi:
Types de publication
Multicenter Study
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
e0285121Informations de copyright
Copyright: © 2023 Topff et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Déclaration de conflit d'intérêts
I have read the journal’s policy and the authors of this manuscript have the following competing interests: Laurens Topff, Merel Huisman, Regina G.H. Beets-Tan: no disclosures; Jacob J. Visser: medical advisor Noaber Foundation, medical advisor NLC, medical advisor Contextflow GmbH, medical advisor Quibim S.L.; Julien Guiot: personal fees for advisory board, work and lectures from Boehringer Ingelheim, Janssens, GSK, Roche and Chiesi, non-financial support for meeting attendance from Chiesi, Roche, Boehringer Ingelheim and Janssens, permanent SAB of Radiomics (Oncoradiomics SA) for the SALMON trial without any specific consultancy fee for this work, co-inventor of one issued patent on radiomics licensed to Radiomics (Oncoradiomics SA); Erik R. Ranschaert: medical advisor Quibim S.L, medical advisor Robovision BV; Ángel Alberich-Bayarri: CEO and a shareholder of Quibim S.L.; José Sánchez-García, Rafael López-González, Ana Jiménez Pastor, Almudena Fuster-Matanzo: current or past employees of Quibim S.L.
Références
Lancet Infect Dis. 2020 Apr;20(4):384-385
pubmed: 32105641
Radiology. 2020 Jul;296(1):172-180
pubmed: 32255413
Eur J Radiol. 2020 Feb;123:108774
pubmed: 31841881
Eur Respir J. 2020 Apr 30;55(4):
pubmed: 32139463
Nat Rev Genet. 2021 Jul;22(7):415-426
pubmed: 33948037
Front Med (Lausanne). 2022 Aug 29;9:930055
pubmed: 36106317
Lancet Infect Dis. 2020 Apr;20(4):425-434
pubmed: 32105637
Radiology. 2020 Sep;296(3):E156-E165
pubmed: 32339081
Eur Radiol. 2020 Dec;30(12):6770-6778
pubmed: 32591888
Eur J Radiol. 2020 May;126:108961
pubmed: 32229322
Eur Radiol. 2020 Dec;30(12):6808-6817
pubmed: 32623505
Radiology. 2021 Apr;299(1):E204-E213
pubmed: 33399506
Ann Clin Microbiol Antimicrob. 2021 May 18;20(1):35
pubmed: 34006330
Diagn Interv Imaging. 2021 Feb;102(2):69-75
pubmed: 33281082
Phys Med. 2021 Jul;87:115-122
pubmed: 34139383
Infection. 2023 Feb;51(1):1-19
pubmed: 35471631
Insights Imaging. 2021 Nov 2;12(1):155
pubmed: 34727257
Radiol Cardiothorac Imaging. 2020 Oct 01;2(5):e200389
pubmed: 33778629
Sci Rep. 2022 Feb 25;12(1):3212
pubmed: 35217712
Br J Radiol. 2021 Mar 01;94(1119):20201039
pubmed: 33353381
Cell. 2020 Jun 11;181(6):1423-1433.e11
pubmed: 32416069
Front Med (Lausanne). 2021 Sep 30;8:704256
pubmed: 34660623
Curr Med Imaging. 2023;19(4):327-332
pubmed: 35726406
Eur Radiol. 2021 Aug;31(8):6096-6104
pubmed: 33629156
Sci Rep. 2020 Nov 5;10(1):19196
pubmed: 33154542
Eur Respir J. 2020 Apr 23;55(4):
pubmed: 32139464
Eur Respir J. 2020 Aug 6;56(2):
pubmed: 32444412
Multimed Tools Appl. 2021;80(19):29367-29399
pubmed: 34188605
Lancet. 2020 Feb 15;395(10223):497-506
pubmed: 31986264
Eur J Radiol Open. 2020;7:100272
pubmed: 33043101
Radiol Cardiothorac Imaging. 2020 Mar 30;2(2):e200047
pubmed: 33778560
Radiology. 2020 Aug;296(2):E32-E40
pubmed: 32101510
Radiography (Lond). 2021 May;27(2):682-687
pubmed: 33008761
Talanta. 2022 Jul 1;244:123409
pubmed: 35390680
Radiology. 2020 Jun;295(3):715-721
pubmed: 32053470
Radiology. 2020 Aug;296(2):E41-E45
pubmed: 32049601