A deep learning-based application for COVID-19 diagnosis on CT: The Imaging COVID-19 AI initiative.


Journal

PloS one
ISSN: 1932-6203
Titre abrégé: PLoS One
Pays: United States
ID NLM: 101285081

Informations de publication

Date de publication:
2023
Historique:
received: 26 01 2023
accepted: 15 04 2023
medline: 4 5 2023
pubmed: 2 5 2023
entrez: 2 5 2023
Statut: epublish

Résumé

Recently, artificial intelligence (AI)-based applications for chest imaging have emerged as potential tools to assist clinicians in the diagnosis and management of patients with coronavirus disease 2019 (COVID-19). To develop a deep learning-based clinical decision support system for automatic diagnosis of COVID-19 on chest CT scans. Secondarily, to develop a complementary segmentation tool to assess the extent of lung involvement and measure disease severity. The Imaging COVID-19 AI initiative was formed to conduct a retrospective multicentre cohort study including 20 institutions from seven different European countries. Patients with suspected or known COVID-19 who underwent a chest CT were included. The dataset was split on the institution-level to allow external evaluation. Data annotation was performed by 34 radiologists/radiology residents and included quality control measures. A multi-class classification model was created using a custom 3D convolutional neural network. For the segmentation task, a UNET-like architecture with a backbone Residual Network (ResNet-34) was selected. A total of 2,802 CT scans were included (2,667 unique patients, mean [standard deviation] age = 64.6 [16.2] years, male/female ratio 1.3:1). The distribution of classes (COVID-19/Other type of pulmonary infection/No imaging signs of infection) was 1,490 (53.2%), 402 (14.3%), and 910 (32.5%), respectively. On the external test dataset, the diagnostic multiclassification model yielded high micro-average and macro-average AUC values (0.93 and 0.91, respectively). The model provided the likelihood of COVID-19 vs other cases with a sensitivity of 87% and a specificity of 94%. The segmentation performance was moderate with Dice similarity coefficient (DSC) of 0.59. An imaging analysis pipeline was developed that returned a quantitative report to the user. We developed a deep learning-based clinical decision support system that could become an efficient concurrent reading tool to assist clinicians, utilising a newly created European dataset including more than 2,800 CT scans.

Sections du résumé

BACKGROUND
Recently, artificial intelligence (AI)-based applications for chest imaging have emerged as potential tools to assist clinicians in the diagnosis and management of patients with coronavirus disease 2019 (COVID-19).
OBJECTIVES
To develop a deep learning-based clinical decision support system for automatic diagnosis of COVID-19 on chest CT scans. Secondarily, to develop a complementary segmentation tool to assess the extent of lung involvement and measure disease severity.
METHODS
The Imaging COVID-19 AI initiative was formed to conduct a retrospective multicentre cohort study including 20 institutions from seven different European countries. Patients with suspected or known COVID-19 who underwent a chest CT were included. The dataset was split on the institution-level to allow external evaluation. Data annotation was performed by 34 radiologists/radiology residents and included quality control measures. A multi-class classification model was created using a custom 3D convolutional neural network. For the segmentation task, a UNET-like architecture with a backbone Residual Network (ResNet-34) was selected.
RESULTS
A total of 2,802 CT scans were included (2,667 unique patients, mean [standard deviation] age = 64.6 [16.2] years, male/female ratio 1.3:1). The distribution of classes (COVID-19/Other type of pulmonary infection/No imaging signs of infection) was 1,490 (53.2%), 402 (14.3%), and 910 (32.5%), respectively. On the external test dataset, the diagnostic multiclassification model yielded high micro-average and macro-average AUC values (0.93 and 0.91, respectively). The model provided the likelihood of COVID-19 vs other cases with a sensitivity of 87% and a specificity of 94%. The segmentation performance was moderate with Dice similarity coefficient (DSC) of 0.59. An imaging analysis pipeline was developed that returned a quantitative report to the user.
CONCLUSION
We developed a deep learning-based clinical decision support system that could become an efficient concurrent reading tool to assist clinicians, utilising a newly created European dataset including more than 2,800 CT scans.

Identifiants

pubmed: 37130128
doi: 10.1371/journal.pone.0285121
pii: PONE-D-23-02337
pmc: PMC10153726
doi:

Types de publication

Multicenter Study Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

e0285121

Informations de copyright

Copyright: © 2023 Topff et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Déclaration de conflit d'intérêts

I have read the journal’s policy and the authors of this manuscript have the following competing interests: Laurens Topff, Merel Huisman, Regina G.H. Beets-Tan: no disclosures; Jacob J. Visser: medical advisor Noaber Foundation, medical advisor NLC, medical advisor Contextflow GmbH, medical advisor Quibim S.L.; Julien Guiot: personal fees for advisory board, work and lectures from Boehringer Ingelheim, Janssens, GSK, Roche and Chiesi, non-financial support for meeting attendance from Chiesi, Roche, Boehringer Ingelheim and Janssens, permanent SAB of Radiomics (Oncoradiomics SA) for the SALMON trial without any specific consultancy fee for this work, co-inventor of one issued patent on radiomics licensed to Radiomics (Oncoradiomics SA); Erik R. Ranschaert: medical advisor Quibim S.L, medical advisor Robovision BV; Ángel Alberich-Bayarri: CEO and a shareholder of Quibim S.L.; José Sánchez-García, Rafael López-González, Ana Jiménez Pastor, Almudena Fuster-Matanzo: current or past employees of Quibim S.L.

Références

Lancet Infect Dis. 2020 Apr;20(4):384-385
pubmed: 32105641
Radiology. 2020 Jul;296(1):172-180
pubmed: 32255413
Eur J Radiol. 2020 Feb;123:108774
pubmed: 31841881
Eur Respir J. 2020 Apr 30;55(4):
pubmed: 32139463
Nat Rev Genet. 2021 Jul;22(7):415-426
pubmed: 33948037
Front Med (Lausanne). 2022 Aug 29;9:930055
pubmed: 36106317
Lancet Infect Dis. 2020 Apr;20(4):425-434
pubmed: 32105637
Radiology. 2020 Sep;296(3):E156-E165
pubmed: 32339081
Eur Radiol. 2020 Dec;30(12):6770-6778
pubmed: 32591888
Eur J Radiol. 2020 May;126:108961
pubmed: 32229322
Eur Radiol. 2020 Dec;30(12):6808-6817
pubmed: 32623505
Radiology. 2021 Apr;299(1):E204-E213
pubmed: 33399506
Ann Clin Microbiol Antimicrob. 2021 May 18;20(1):35
pubmed: 34006330
Diagn Interv Imaging. 2021 Feb;102(2):69-75
pubmed: 33281082
Phys Med. 2021 Jul;87:115-122
pubmed: 34139383
Infection. 2023 Feb;51(1):1-19
pubmed: 35471631
Insights Imaging. 2021 Nov 2;12(1):155
pubmed: 34727257
Radiol Cardiothorac Imaging. 2020 Oct 01;2(5):e200389
pubmed: 33778629
Sci Rep. 2022 Feb 25;12(1):3212
pubmed: 35217712
Br J Radiol. 2021 Mar 01;94(1119):20201039
pubmed: 33353381
Cell. 2020 Jun 11;181(6):1423-1433.e11
pubmed: 32416069
Front Med (Lausanne). 2021 Sep 30;8:704256
pubmed: 34660623
Curr Med Imaging. 2023;19(4):327-332
pubmed: 35726406
Eur Radiol. 2021 Aug;31(8):6096-6104
pubmed: 33629156
Sci Rep. 2020 Nov 5;10(1):19196
pubmed: 33154542
Eur Respir J. 2020 Apr 23;55(4):
pubmed: 32139464
Eur Respir J. 2020 Aug 6;56(2):
pubmed: 32444412
Multimed Tools Appl. 2021;80(19):29367-29399
pubmed: 34188605
Lancet. 2020 Feb 15;395(10223):497-506
pubmed: 31986264
Eur J Radiol Open. 2020;7:100272
pubmed: 33043101
Radiol Cardiothorac Imaging. 2020 Mar 30;2(2):e200047
pubmed: 33778560
Radiology. 2020 Aug;296(2):E32-E40
pubmed: 32101510
Radiography (Lond). 2021 May;27(2):682-687
pubmed: 33008761
Talanta. 2022 Jul 1;244:123409
pubmed: 35390680
Radiology. 2020 Jun;295(3):715-721
pubmed: 32053470
Radiology. 2020 Aug;296(2):E41-E45
pubmed: 32049601

Auteurs

Laurens Topff (L)

Department of Radiology, Netherlands Cancer Institute, Amsterdam, The Netherlands.
GROW School for Oncology and Reproduction, Maastricht University, Maastricht, The Netherlands.

José Sánchez-García (J)

Quantitative Imaging Biomarkers in Medicine (Quibim), Valencia, Spain.

Rafael López-González (R)

Quantitative Imaging Biomarkers in Medicine (Quibim), Valencia, Spain.

Ana Jiménez Pastor (AJ)

Quantitative Imaging Biomarkers in Medicine (Quibim), Valencia, Spain.

Jacob J Visser (JJ)

Department of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands.

Merel Huisman (M)

Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands.

Julien Guiot (J)

Department of Pneumology, University Hospital of Liège (CHU Liège), Liège, Belgium.

Regina G H Beets-Tan (RGH)

Department of Radiology, Netherlands Cancer Institute, Amsterdam, The Netherlands.
GROW School for Oncology and Reproduction, Maastricht University, Maastricht, The Netherlands.

Angel Alberich-Bayarri (A)

Quantitative Imaging Biomarkers in Medicine (Quibim), Valencia, Spain.

Almudena Fuster-Matanzo (A)

Quantitative Imaging Biomarkers in Medicine (Quibim), Valencia, Spain.

Erik R Ranschaert (ER)

Department of Radiology, St. Nikolaus Hospital, Eupen, Belgium.
Ghent University, Ghent, Belgium.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH