A practical artificial intelligence system to diagnose COVID-19 using computed tomography: A multinational external validation study.
Artificial intelligence
Coronavirus infections
Machine learning
Pneumonia
Tomography, X-ray computed
Journal
Pattern recognition letters
ISSN: 0167-8655
Titre abrégé: Pattern Recognit Lett
Pays: Netherlands
ID NLM: 9879988
Informations de publication
Date de publication:
Dec 2021
Dec 2021
Historique:
received:
08
04
2021
revised:
14
08
2021
accepted:
16
09
2021
pubmed:
29
9
2021
medline:
29
9
2021
entrez:
28
9
2021
Statut:
ppublish
Résumé
Computed tomography has gained an important role in the early diagnosis of COVID-19 pneumonia. However, the ever-increasing number of patients has overwhelmed radiology departments and has caused a reduction in quality of services. Artificial intelligence (AI) systems are the remedy to the current situation. However, the lack of application in real-world conditions has limited their consideration in clinical settings. This study validated a clinical AI system, COVIDiag, to aid radiologists in accurate and rapid evaluation of COVID-19 cases. 50 COVID-19 and 50 non-COVID-19 pneumonia cases were included from each of five centers: Argentina, Turkey, Iran, Netherlands, and Italy. The Dutch database included only 50 COVID-19 cases. The performance parameters namely sensitivity, specificity, accuracy, and area under the ROC curve (AUC) were computed for each database using COVIDiag model. The most common pattern of involvement among COVID-19 cases in all databases were bilateral involvement of upper and lower lobes with ground-glass opacities. The best sensitivity of 92.0% was recorded for the Italian database. The system achieved an AUC of 0.983, 0.914, 0.910, and 0.882 for Argentina, Turkey, Iran, and Italy, respectively. The model obtained a sensitivity of 86.0% for the Dutch database. COVIDiag model could diagnose COVID-19 pneumonia in all of cohorts with AUC of 0.921 (sensitivity, specificity, and accuracy of 88.8%, 87.0%, and 88.0%, respectively). Our study confirmed the accuracy of our proposed AI model (COVIDiag) in the diagnosis of COVID-19 cases. Furthermore, the system demonstrated consistent optimal diagnostic performance on multinational databases, which is critical to determine the generalizability and objectivity of the proposed COVIDiag model. Our results are significant as they provide real-world evidence regarding the applicability of AI systems in clinical medicine.
Identifiants
pubmed: 34580550
doi: 10.1016/j.patrec.2021.09.012
pii: S0167-8655(21)00339-1
pmc: PMC8457921
doi:
Types de publication
Journal Article
Langues
eng
Pagination
42-49Informations de copyright
© 2021 Elsevier B.V. All rights reserved.
Déclaration de conflit d'intérêts
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Références
Reprod Biomed Online. 2020 Sep;41(3):483-499
pubmed: 32651106
Radiol Med. 2020 May;125(5):505-508
pubmed: 32350794
Eur Radiol. 2020 Dec;30(12):6818-6827
pubmed: 32666316
AI Soc. 2020;35(3):761-765
pubmed: 32346223
Radiol Cardiothorac Imaging. 2020 Feb 13;2(1):e200034
pubmed: 33778547
Nat Commun. 2020 Aug 14;11(1):4080
pubmed: 32796848
Int J Surg. 2020 May;77:206-216
pubmed: 32289472
Lancet Digit Health. 2020 Oct;2(10):e506-e515
pubmed: 32984796
Nat Commun. 2020 Oct 9;11(1):5088
pubmed: 33037212
Radiology. 2020 Aug;296(2):E113-E114
pubmed: 32105562
Chest. 2020 Jul;158(1):106-116
pubmed: 32275978
Eur Radiol. 2021 Jan;31(1):121-130
pubmed: 32740817
Jpn J Radiol. 2019 Jun;37(6):437-448
pubmed: 30891667
Acad Radiol. 2020 Nov;27(11):1608-1621
pubmed: 32773328
Eur Radiol. 2019 Jan;29(1):141-143
pubmed: 30027407
J Clin Virol. 2020 Jul;128:104412
pubmed: 32416600
Radiology. 2021 Feb;298(2):E88-E97
pubmed: 32969761
Radiology. 2021 Jan;298(1):E18-E28
pubmed: 32729810
N Engl J Med. 2020 Aug 6;383(6):e38
pubmed: 32502334
Radiology. 2020 Aug;296(2):E46-E54
pubmed: 32155105
Comput Biol Med. 2020 Jun;121:103795
pubmed: 32568676
Clin Radiol. 2020 May;75(5):323-325
pubmed: 32216962
Radiol Cardiothorac Imaging. 2020 Apr 20;2(2):e200130
pubmed: 33778569
Cell. 2020 Jun 11;181(6):1423-1433.e11
pubmed: 32416069
Clin Microbiol Infect. 2006 May;12 Suppl 3:12-24
pubmed: 16669925
Br J Radiol. 2019 Jul;92(1099):20190043
pubmed: 30933540
Eur J Radiol. 2020 May;126:108961
pubmed: 32229322
Diagn Interv Radiol. 2021 May;27(3):336-343
pubmed: 32876570
BMC Infect Dis. 2020 Jul 16;20(1):517
pubmed: 32677909
Radiology. 2020 Aug;296(2):E15-E25
pubmed: 32083985
Eur Respir J. 2020 Aug 6;56(2):
pubmed: 32444412
Acad Radiol. 2020 May;27(5):750
pubmed: 32303440
Radiology. 2020 Aug;296(2):E86-E96
pubmed: 32301647
J Med Virol. 2021 Apr;93(4):2307-2320
pubmed: 33247599
Radiology. 2020 Aug;296(2):E115-E117
pubmed: 32073353
Clin Imaging. 2020 Nov;67:121-129
pubmed: 32619773