Current status and future perspective on artificial intelligence for lower endoscopy.
artificial intelligence
colonoscopy
colorectal cancer
computer-aided diagnosis
Journal
Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society
ISSN: 1443-1661
Titre abrégé: Dig Endosc
Pays: Australia
ID NLM: 9101419
Informations de publication
Date de publication:
Jan 2021
Jan 2021
Historique:
received:
11
07
2020
revised:
03
09
2020
accepted:
16
09
2020
pubmed:
25
9
2020
medline:
29
7
2021
entrez:
24
9
2020
Statut:
ppublish
Résumé
The global incidence and mortality rate of colorectal cancer remains high. Colonoscopy is regarded as the gold standard examination for detecting and eradicating neoplastic lesions. However, there are some uncertainties in colonoscopy practice that are related to limitations in human performance. First, approximately one-fourth of colorectal neoplasms are missed on a single colonoscopy. Second, it is still difficult for non-experts to perform adequately regarding optical biopsy. Third, recording of some quality indicators (e.g. cecal intubation, bowel preparation, and withdrawal speed) which are related to adenoma detection rate, is sometimes incomplete. With recent improvements in machine learning techniques and advances in computer performance, artificial intelligence-assisted computer-aided diagnosis is being increasingly utilized by endoscopists. In particular, the emergence of deep-learning, data-driven machine learning techniques have made the development of computer-aided systems easier than that of conventional machine learning techniques, the former currently being considered the standard artificial intelligence engine of computer-aided diagnosis by colonoscopy. To date, computer-aided detection systems seem to have improved the rate of detection of neoplasms. Additionally, computer-aided characterization systems may have the potential to improve diagnostic accuracy in real-time clinical practice. Furthermore, some artificial intelligence-assisted systems that aim to improve the quality of colonoscopy have been reported. The implementation of computer-aided system clinical practice may provide additional benefits such as helping in educational poorly performing endoscopists and supporting real-time clinical decision-making. In this review, we have focused on computer-aided diagnosis during colonoscopy reported by gastroenterologists and discussed its status, limitations, and future prospects.
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
273-284Subventions
Organisme : Japan Society for the Promotion of Science
ID : 19K17504
Informations de copyright
© 2020 Japan Gastroenterological Endoscopy Society.
Références
Zauber AG, Winawer SJ, O'Brien MJ et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N Engl J Med 2012; 366: 687-96.
Winawer SJ, Zauber AG, Ho MN et al. Prevention of colorectal cancer by colonoscopic polypectomy. The National Polyp Study Workgroup. N Engl J Med 1993; 329: 1977-81.
Kaminski MF, Regula J, Kraszewska E et al. Quality indicators for colonoscopy and the risk of interval cancer. N Engl J Med 2010; 362: 1795-803.
Corley DA, Jensen CD, Marks AR et al. Adenoma detection rate and risk of colorectal cancer and death. N Engl J Med 2014; 370: 1298-306.
Rex DK, Kahi C, O'Brien M et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc 2011; 73: 419-22.
Committee AT, Abu Dayyeh BK, Thosani N et al. ASGE Technology Committee systematic review and meta-analysis assessing the ASGE PIVI thresholds for adopting real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc 2015; 81: 502.e1-6.
Ladabaum U, Fioritto A, Mitani A et al. Real-time optical biopsy of colon polyps with narrow band imaging in community practice does not yet meet key thresholds for clinical decisions. Gastroenterology 2013; 144: 81-91.
Rees CJ, Rajasekhar PT, Wilson A et al. Narrow band imaging optical diagnosis of small colorectal polyps in routine clinical practice: the Detect Inspect Characterise Resect and Discard 2 (DISCARD 2) study. Gut 2017; 66: 887-95.
Karkanis SA, Iakovidis DK, Maroulis DE, Karras DA, Tzivras M. Computer-aided tumor detection in endoscopic video using color wavelet features. IEEE Trans Inf Technol Biomed 2003; 7: 141-52.
Maroulis DE, Iakovidis DK, Karkanis SA, Karras DA. CoLD: a versatile detection system for colorectal lesions in endoscopy video-frames. Comput Methods Programs Biomed 2003; 70: 151-66.
Jerebko A, Lakare S, Cathier P, Periaswamy S, Bogoni L. Symmetric curvature patterns for colonic polyp detection. Med Image Comput Comput Assist Interv 2006; 9: 169-76.
Plagianakos VP, Magoulas GD, Vrahatis MN. Distributed computing methodology for training neural networks in an image-guided diagnostic application. Comput Methods Programs Biomed 2006; 81: 228-35.
Park SY, Sargent D, Spofford I, Vosburgh KG, A-Rahim Y. A colon video analysis framework for polyp detection. IEEE Trans Biomed Eng 2012; 59: 1408-18.
Wang Y, Tavanapong W, Wong J, Oh J, de Groen PC. Part-based multiderivative edge cross-sectional profiles for polyp detection in colonoscopy. IEEE J Biomed Health Inform 2014; 18: 1379-89.
Tajbakhsh N, Gurudu SR, Liang J. A comprehensive computer-aided polyp detection system for colonoscopy videos. Inf Process Med Imaging 2015; 24: 327-38.
Bernal J, Sanchez FJ, Fernandez-Esparrach G, Gil D, Rodriguez C, Vilarino F. WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians. Comput Med Imaging Graph 2015; 43: 99-111.
Wang H, Liang Z, Li LC et al. An adaptive paradigm for computer-aided detection of colonic polyps. Phys Med Biol 2015; 60: 7207-28.
Du N, Wang X, Guo J, Xu M. Attraction propagation: A user-friendly interactive approach for polyp segmentation in colonoscopy images. PLoS One 2016; 11: e0155371.
Tajbakhsh N, Gurudu SR, Liang J. Automated polyp detection in colonoscopy videos using shape and context information. IEEE Trans Med Imaging 2016; 35: 630-44.
Fernandez-Esparrach G, Bernal J, Lopez-Ceron M et al. Exploring the clinical potential of an automatic colonic polyp detection method based on the creation of energy maps. Endoscopy 2016; 48: 837-42.
Misawa M, Kudo SE, Mori Y et al. Artificial intelligence-assisted polyp detection for colonoscopy: Initial experience. Gastroenterology 2018; 154: 2027-29.e3.
Urban G, Tripathi P, Alkayali T et al. Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy. Gastroenterology 2018; 155: 1069-78.e8.
Wang P, Xiao X, Glissen Brown JR et al. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat Biomed Eng 2018; 2: 741-8.
Yamada M, Saito Y, Imaoka H et al. Development of a real-time endoscopic image diagnosis support system using deep learning technology in colonoscopy. Sci Rep 2019; 9: 14465.
Misawa M, Kudo SE, Mori Y et al. Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video). Gastrointest Endosc. Published online: 31 Jul 2020; https://doi.org/10.1016/j.gie.2020.07.060
Wang P, Berzin TM, Glissen Brown JR et al. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: A prospective randomised controlled study. Gut 2019; 68: 1813-9.
Su JR, Li Z, Shao XJ et al. Impact of a real-time automatic quality control system on colorectal polyp and adenoma detection: a prospective randomized controlled study (with videos). Gastrointest Endosc 2020; 91: 415-24.e4.
Liu WN, Zhang YY, Bian XQ et al. Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy. Saudi J Gastroenterol 2020; 26: 13-9.
Gong D, Wu L, Zhang J et al. Detection of colorectal adenomas with a real-time computer-aided system (ENDOANGEL): A randomised controlled study. Lancet Gastroenterol Hepatol 2020; 5: 352-61.
Wang P, Liu X, Berzin TM et al. Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): A double-blind randomised study. Lancet Gastroenterol Hepatol 2020; 5: 343-51.
Repici A, Badalamenti M, Maselli R et al. Efficacy of real-time computer-aided detection of colorectal neoplasia in a randomized trial. Gastroenterology 2020; 159: 512-20.e7.
Wang P, Liu P, Glissen Brown JR et al. Lower adenoma miss rate of computer-aided detection-assisted colonoscopy vs routine white-light colonoscopy in a prospective tandem study. Gastroenterology 2020; 159: 1252-61.e5.
Komeda Y, Handa H, Watanabe T et al. Computer-aided diagnosis based on convolutional neural network system for colorectal polyp classification: Preliminary experience. Oncology 2017; 93(Suppl 1): 30-4.
Tischendorf JJ, Gross S, Winograd R et al. Computer-aided classification of colorectal polyps based on vascular patterns: A pilot study. Endoscopy 2010; 42: 203-7.
Gross S, Trautwein C, Behrens A et al. Computer-based classification of small colorectal polyps by using narrow-band imaging with optical magnification. Gastrointest Endosc 2011; 74: 1354-9.
Takemura Y, Yoshida S, Tanaka S et al. Computer-aided system for predicting the histology of colorectal tumors by using narrow-band imaging magnifying colonoscopy (with video). Gastrointest Endosc 2012; 75: 179-85.
Tamaki T, Yoshimuta J, Kawakami M et al. Computer-aided colorectal tumor classification in NBI endoscopy using local features. Med Image Anal 2013; 17: 78-100.
Hirakawa T, Tamaki T, Raytchev B et al. SVM-MRF segmentation of colorectal NBI endoscopic images. Conf Proc IEEE Eng Med Biol Soc 2014; 2014: 4739-42.
Hafner M, Tamaki T, Tanaka S, Uhl A, Wimmer G, Yoshida S. Local fractal dimension based approaches for colonic polyp classification. Med Image Anal 2015; 26: 92-107.
Kominami Y, Yoshida S, Tanaka S et al. Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. Gastrointest Endosc 2016; 83: 643-9.
Wimmer G, Tamaki T, Tischendorf JJ et al Directional wavelet based features for colonic polyp classification. Med Image Anal 2016; 31: 16-36.
Okamoto T, Koide T, Sugi K et al. Image segmentation of pyramid style identifier based on Support Vector Machine for colorectal endoscopic images. Conf Proc IEEE Eng Med Biol Soc 2015; 2015: 2997-3000.
Chen PJ, Lin MC, Lai MJ, Lin JC, Lu HH, Tseng VS. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology 2018; 154: 568-75.
Byrne MF, Chapados N, Soudan F et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 2019; 68: 94-100.
Zachariah R, Samarasena J, Luba D et al. Prediction of polyp pathology using convolutional neural networks achieves “resect and discard” thresholds. Am J Gastroenterol 2020; 115: 138-44.
Lui TKL, Wong KKY, Mak LLY, Ko MKL, Tsao SKK, Leung WK. Endoscopic prediction of deeply submucosal invasive carcinoma with use of artificial intelligence. Endosc Int Open 2019; 7: E514-20.
Renner J, Phlipsen H, Haller B et al. Optical classification of neoplastic colorectal polyps - a computer-assisted approach (the COACH study). Scand J Gastroenterol 2018; 53: 1100-6.
Sakamoto T, Nakajima T, Matsuda T et al. Comparison of the diagnostic performance between magnifying chromoendoscopy and magnifying narrow-band imaging for superficial colorectal neoplasms: an online survey. Gastrointest Endosc 2018; 87: 1318-23.
Hafner M, Liedlgruber M, Uhl A, Vecsei A, Wrba F. Color treatment in endoscopic image classification using multi-scale local color vector patterns. Med Image Anal 2012; 16: 75-86.
Takemura Y, Yoshida S, Tanaka S et al. Quantitative analysis and development of a computer-aided system for identification of regular pit patterns of colorectal lesions. Gastrointest Endosc 2010; 72: 1047.
Kiesslich R, Burg J, Vieth M et al. Confocal laser endoscopy for diagnosing intraepithelial neoplasias and colorectal cancer in vivo. Gastroenterology 2004; 127: 706-13.
Mori Y, Kudo S, Ikehara N et al. Comprehensive diagnostic ability of endocytoscopy compared with biopsy for colorectal neoplasms: a prospective randomized noninferiority trial. Endoscopy 2013; 45: 98-105.
Kodashima S, Fujishiro M, Takubo K et al. Ex vivo pilot study using computed analysis of endo-cytoscopic images to differentiate normal and malignant squamous cell epithelia in the oesophagus. Dig Liver Dis 2007; 39: 762-6.
Mori Y, Kudo S-e, Wakamura K et al. Novel computer-aided diagnostic system for colorectal lesions by using endocytoscopy (with videos). Gastrointest Endosc 2015; 81: 621-9.
Mori Y, Kudo SE, Chiu PW et al. Impact of an automated system for endocytoscopic diagnosis of small colorectal lesions: An international web-based study. Endoscopy 2016; 48: 1110-8.
Mori Y, Kudo SE, Mori K. Potential of artificial intelligence-assisted colonoscopy using an endocytoscope (with video). Dig Endosc 2018; 30(Suppl 1): 52-3.
Kudo SE, Misawa M, Mori Y et al. Artificial Intelligence-assisted System Improves Endoscopic Identification of Colorectal Neoplasms. Clin Gastroenterol Hepatol. 2020; 18: 1874-881.e2.
Misawa M, Kudo SE, Mori Y et al. Characterization of colorectal lesions using a computer-aided diagnostic system for narrow-band imaging endocytoscopy. Gastroenterology 2016; 150: 1531-2.e3.
Mori Y, Kudo SE, Misawa M et al. Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy: A prospective study. Ann Intern Med 2018; 169: 357-66.
Takeda K, Kudo S, Mori Y et al. Accuracy of diagnosing invasie colorectal cancer using computer-aided endocytoscopy. Endoscopy 2017; 49: 798-802.
Mori Y, Kudo SE, Misawa M, Mori K. Simultaneous detection and characterization of diminutive polyps with the use of artificial intelligence during colonoscopy. VideoGIE 2019; 4: 7-10.
Ozawa T, Ishihara S, Fujishiro M, Kumagai Y, Shichijo S, Tada T. Automated endoscopic detection and classification of colorectal polyps using convolutional neural networks. Therap Adv Gastroenterol 2020; 13: 1756284820910659.
Froslie KF, Jahnsen J, Moum BA, Vatn MH. Mucosal healing in inflammatory bowel disease: results from a Norwegian population-based cohort. Gastroenterology 2007; 133: 412-22.
Osada T, Ohkusa T, Yokoyama T et al. Comparison of several activity indices for the evaluation of endoscopic activity in UC: Inter- and intraobserver consistency. Inflamm Bowel Dis 2010; 16: 192-7.
Ozawa T, Ishihara S, Fujishiro M et al Novel computer-assisted diagnosis system for endoscopic disease activity in patients with ulcerative colitis. Gastrointest Endosc 2019; 89: 416-21.e1.
Stidham RW, Liu W, Bishu S et al. Performance of a deep learning model vs human reviewers in grading endoscopic disease severity of patients with ulcerative colitis. JAMA Netw Open 2019; 2: e193963.
Bossuyt P, Nakase H, Vermeire S et al. Automatic, computer-aided determination of endoscopic and histological inflammation in patients with mild to moderate ulcerative colitis based on red density. Gut 2020; 69: 1778-86.
Takenaka K, Ohtsuka K, Fujii T et al. Development and validation of a deep neural network for accurate evaluation of endoscopic images from patients with ulcerative colitis. Gastroenterology 2020; 158: 2150-7.
Ma R, Wang R, Pizer S, Rosenman J, McGill SK, Frahm J-M. Real-time 3d reconstruction of colonoscopic surfaces for determining missing regions. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin: Springer 2019; 573-82.
Barua I, Vinsard D, Jodal H et al. Artificial intelligence for polyp detection during colonoscopy: A systematic review and meta-analysis. Endoscopy. Published online: 17 Jun 2020; https://doi.org/10.1055/a-1201-7165
Cybernet Systems. EndoBRAIN(R)-EYE, AI-Equipped Colorectal Endoscopy Diagnosis Support Software Part 2; Acquisition of Approval under Pharmaceutical and Medical Device Act (PMD Act). Available from URL: https://www.cybernet.jp/english/documents/pdf/news/press/2020/20200129.pdf. January 29 2020.
FUJIFILM Holdings America Corporation. Fujifilm acquires CE mark and launches CAD EYE, a function of colonic polyp detection utilizing AI technology, in Europe. Available from URL: https://www.fujifilm.eu/eu/cadeye. February 25, 2020.
Pentax Medical. HOYA Group PENTAX Medical Cleared CE Mark for DISCOVERY™, an AI Assisted Polyp Detector. Available from URL: https://www.pentaxmedical.com/pentax/en/92/1/HOYA-Group-PENTAX-Medical-Cleared-CE-Mark-for-DISCOVERY-an-AI-Assisted-Polyp-Detector. December 16, 2019.
Medtronic. Medtronic Launches the First Artificial Intelligence System for Colonoscopy at United European Gastroenterology Week 2019. Available from URL: http://newsroom.medtronic.com/news-releases/news-release-details/medtronic-launches-first-artificial-intelligence-system/. October 17, 2019.
Mori Y, Kudo SE, East JE et al. Cost savings in colonoscopy with artificial intelligence-aided polyp diagnosis: An add-on analysis of a clinical trial (with video). Gastrointest Endosc 2020; 92: 905-11.e1.