Automated classification of polyps using deep learning architectures and few-shot learning.
Automation
Deep learning
Deep metric learning
Endoscopy
Few-shot learning
Gastroenterology
Image classification
Machine learning
Transformer
Journal
BMC medical imaging
ISSN: 1471-2342
Titre abrégé: BMC Med Imaging
Pays: England
ID NLM: 100968553
Informations de publication
Date de publication:
20 04 2023
20 04 2023
Historique:
received:
26
09
2022
accepted:
24
03
2023
medline:
24
4
2023
pubmed:
21
4
2023
entrez:
20
04
2023
Statut:
epublish
Résumé
Colorectal cancer is a leading cause of cancer-related deaths worldwide. The best method to prevent CRC is a colonoscopy. However, not all colon polyps have the risk of becoming cancerous. Therefore, polyps are classified using different classification systems. After the classification, further treatment and procedures are based on the classification of the polyp. Nevertheless, classification is not easy. Therefore, we suggest two novel automated classifications system assisting gastroenterologists in classifying polyps based on the NICE and Paris classification. We build two classification systems. One is classifying polyps based on their shape (Paris). The other classifies polyps based on their texture and surface patterns (NICE). A two-step process for the Paris classification is introduced: First, detecting and cropping the polyp on the image, and secondly, classifying the polyp based on the cropped area with a transformer network. For the NICE classification, we design a few-shot learning algorithm based on the Deep Metric Learning approach. The algorithm creates an embedding space for polyps, which allows classification from a few examples to account for the data scarcity of NICE annotated images in our database. For the Paris classification, we achieve an accuracy of 89.35 %, surpassing all papers in the literature and establishing a new state-of-the-art and baseline accuracy for other publications on a public data set. For the NICE classification, we achieve a competitive accuracy of 81.13 % and demonstrate thereby the viability of the few-shot learning paradigm in polyp classification in data-scarce environments. Additionally, we show different ablations of the algorithms. Finally, we further elaborate on the explainability of the system by showing heat maps of the neural network explaining neural activations. Overall we introduce two polyp classification systems to assist gastroenterologists. We achieve state-of-the-art performance in the Paris classification and demonstrate the viability of the few-shot learning paradigm in the NICE classification, addressing the prevalent data scarcity issues faced in medical machine learning.
Sections du résumé
BACKGROUND
Colorectal cancer is a leading cause of cancer-related deaths worldwide. The best method to prevent CRC is a colonoscopy. However, not all colon polyps have the risk of becoming cancerous. Therefore, polyps are classified using different classification systems. After the classification, further treatment and procedures are based on the classification of the polyp. Nevertheless, classification is not easy. Therefore, we suggest two novel automated classifications system assisting gastroenterologists in classifying polyps based on the NICE and Paris classification.
METHODS
We build two classification systems. One is classifying polyps based on their shape (Paris). The other classifies polyps based on their texture and surface patterns (NICE). A two-step process for the Paris classification is introduced: First, detecting and cropping the polyp on the image, and secondly, classifying the polyp based on the cropped area with a transformer network. For the NICE classification, we design a few-shot learning algorithm based on the Deep Metric Learning approach. The algorithm creates an embedding space for polyps, which allows classification from a few examples to account for the data scarcity of NICE annotated images in our database.
RESULTS
For the Paris classification, we achieve an accuracy of 89.35 %, surpassing all papers in the literature and establishing a new state-of-the-art and baseline accuracy for other publications on a public data set. For the NICE classification, we achieve a competitive accuracy of 81.13 % and demonstrate thereby the viability of the few-shot learning paradigm in polyp classification in data-scarce environments. Additionally, we show different ablations of the algorithms. Finally, we further elaborate on the explainability of the system by showing heat maps of the neural network explaining neural activations.
CONCLUSION
Overall we introduce two polyp classification systems to assist gastroenterologists. We achieve state-of-the-art performance in the Paris classification and demonstrate the viability of the few-shot learning paradigm in the NICE classification, addressing the prevalent data scarcity issues faced in medical machine learning.
Identifiants
pubmed: 37081495
doi: 10.1186/s12880-023-01007-4
pii: 10.1186/s12880-023-01007-4
pmc: PMC10120204
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
59Informations de copyright
© 2023. The Author(s).
Références
Therap Adv Gastroenterol. 2020 Mar 20;13:1756284820910659
pubmed: 32231710
IEEE Trans Med Imaging. 2016 Sep;35(9):2051-2063
pubmed: 28005009
Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:6742-6745
pubmed: 31947388
Am J Gastroenterol. 2015 Jan;110(1):180-7
pubmed: 25331346
Frontline Gastroenterol. 2015 Apr;6(2):117-126
pubmed: 28839798
Endosc Int Open. 2019 Apr;7(4):E514-E520
pubmed: 31041367
Radiol Artif Intell. 2020 Mar 25;2(2):e200029
pubmed: 33937821
PLoS One. 2019 Mar 25;14(3):e0214133
pubmed: 30908513
Histopathology. 2012 Jul;61(1):47-52
pubmed: 22486166
Dig Endosc. 2018 Jul;30(4):543-545
pubmed: 29656581
Sensors (Basel). 2021 Sep 07;21(18):
pubmed: 34577209
Gastrointest Endosc. 2021 Apr;93(4):960-967.e3
pubmed: 32745531
Biomed Eng Online. 2022 May 25;21(1):33
pubmed: 35614504
J Clin Pathol. 1994 Oct;47(10):880-5
pubmed: 7962600
IEEE J Biomed Health Inform. 2017 Jan;21(1):41-47
pubmed: 28114040
Gut. 2019 Jan;68(1):94-100
pubmed: 29066576
Endosc Int Open. 2019 May;7(5):E633-E640
pubmed: 31058205
J Imaging. 2023 Jan 24;9(2):
pubmed: 36826945
Gastroenterology. 2012 Sep;143(3):599-607.e1
pubmed: 22609383
Gastrointest Endosc. 2003 Dec;58(6 Suppl):S3-43
pubmed: 14652541
IEEE Trans Pattern Anal Mach Intell. 2022 Oct;44(10):5962-5979
pubmed: 34106845
Oncology. 2017;93 Suppl 1:30-34
pubmed: 29258081
Gastrointest Endosc. 2013 Oct;78(4):625-32
pubmed: 23910062
Endoscopy. 2005 Jun;37(6):570-8
pubmed: 15933932
Endoscopy. 2017 Mar;49(3):270-297
pubmed: 28212588
Healthcare (Basel). 2022 Aug 08;10(8):
pubmed: 36011151
CA Cancer J Clin. 2018 Nov;68(6):394-424
pubmed: 30207593
Med Phys. 2017 Apr;44(4):1379-1389
pubmed: 28160514