Artificial intelligence and its impact on quality improvement in upper and lower gastrointestinal endoscopy.
artificial intelligence
endoscopy
lower gastrointestinal tract
quality
upper gastrointestinal tract
Journal
Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society
ISSN: 1443-1661
Titre abrégé: Dig Endosc
Pays: Australia
ID NLM: 9101419
Informations de publication
Date de publication:
Jan 2021
Jan 2021
Historique:
received:
28
07
2020
revised:
14
10
2020
accepted:
01
11
2020
pubmed:
5
11
2020
medline:
29
7
2021
entrez:
4
11
2020
Statut:
ppublish
Résumé
Artificial intelligence (AI) and its application in medicine has grown large interest. Within gastrointestinal (GI) endoscopy, the field of colonoscopy and polyp detection is the most investigated, however, upper GI follows the lead. Since endoscopy is performed by humans, it is inherently an imperfect procedure. Computer-aided diagnosis may improve its quality by helping prevent missing lesions and supporting optical diagnosis for those detected. An entire evolution in AI systems has been established in the last decades, resulting in optimization of the diagnostic performance with lower variability and matching or even outperformance of expert endoscopists. This shows a great potential for future quality improvement of endoscopy, given the outstanding diagnostic features of AI. With this narrative review, we highlight the potential benefit of AI to improve overall quality in daily endoscopy and describe the most recent developments for characterization and diagnosis as well as the recent conditions for regulatory approval.
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
242-253Subventions
Organisme : Vlaamse Overheid
Organisme : Fonds Wetenschappelijk Onderzoek
Organisme : KU Leuven
ID : C24/18/047
Organisme : Pentax Medical
Informations de copyright
© 2020 Japan Gastroenterological Endoscopy Society.
Références
Esteva A, Kuprel B, Novoa RA et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017; 542: 115-8.
Baker JA, Rosen EL, Lo JY et al. Computer-aided detection (CAD) in screening mammography: Sensitivity of commercial CAD systems for detection architectural distortion. Am J Roentgenol 2003; 181: 1083-8.
Gulshan V, Peng L, Coram M et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016; 316: 2402-10.
Van Der Sommen F, Zinger S, Curvers WL et al. Computer-aided detection of early neoplastic lesions in Barrett's esophagus. Endoscopy 2016; 48: 617-24.
Urban G, Tripathi P, Alkayali T et al. Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy of the HHS public access. Gastroenterology 2018; 155: 1069-78.
Schölvinck DW, Van Der Meulen K, Bergman JJGHM et al. Detection of lesions in dysplastic Barrett's esophagus by community and expert endoscopists. Endoscopy 2017; 49: 113-20.
Kaminski MF, Regula J, Kraszewska E et al. Quality indicators for colonoscopy and the risk of interval cancer. N Engl J Med 2010; 362: 1795-803.
Kaminski MF, Thomas-Gibson S, Bugajski M et al. Performance measures for lower gastrointestinal endoscopy: A European Society of Gastrointestinal Endoscopy (ESGE) quality improvement initiative. United Eur Gastroenterol J 2017; 5: 309-34.
Smyth EC, Lagergren J, Fitzgerald RC et al. Oesophageal Cancer Europe PMC Funders Group. Nat Rev Dis Prim 2018; 3: 1-44.
Reid BJ, Blount PL, Feng Z et al. Optimizing endoscopic biopsy detection of early cancers in Barrett's high-grade dysplasia. Am J Gastroenterol 2000; 95: 3089-96.
Falk GW, Rice TW, Goldblum JR et al. Jumbo biopsy forceps protocol still misses unsuspected cancer in Barrett's esophagus with high-grade dysplasia. Gastrointest Endoscopy 1999; 49: 170-6.
Sharma P, Savides TJ, Canto MI et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on imaging in Barrett's Esophagus. Gastrointest Endosc 2012; 76: 252-4.
Abrams JA, Kapel RC, Lindberg GM et al. Surveillance in the community setting in the United States. Clin Gastroenterol Hepatol 2009; 7: 710-36.
De Groof J, Van Der Sommen F, Van Der Putten J et al. The Argos project: The development of a computer-aided detection system to improve detection of Barrett's neoplasia on white light endoscopy. Unit 2019; 7: 538-47.
Hashimoto R, Requa J, Dao T et al. Artificial intelligence using convolutional neural networks for real-time detection of early esophageal neoplasia in Barrett's esophagus (with video). Gastrointest Endosc 2020; 91: 1264-71.e1.
de Souza LA, Palm C, Mendel R et al. A survey on Barrett's esophagus analysis using machine learning. Comput Biol Med 2018; 96: 203-13.
de Groof AJ, Struyvenberg MR, van der Putten J et al. Deep-learning system detects neoplasia in patients with Barrett's esophagus with higher accuracy than endoscopists in a multistep training and validation study with benchmarking. Gastroenterology 2020; 158: 915-29.e4.
de Groof AJ, Struyvenberg MR, Fockens KN et al. Deep learning algorithm detection of Barrett's neoplasia with high accuracy during live endoscopic procedures: A pilot study (with video). Gastrointest Endosc 2020; 91: 1242-50.
Ebigbo A, Mendel R, Probst A et al. Real-time use of artificial intelligence in the evaluation of cancer in Barrett's oesophagus. Gut 2020; 69: 615-6.
Ebigbo A, Mendel R, Probst A et al. Computer-aided diagnosis using deep learning in the evaluation of early oesophageal adenocarcinoma. Gut 2019; 68: 1143-5.
Nagami Y, Tominaga K, Machida H et al. Usefulness of non-magnifying narrow-band imaging in screening of early esophageal squamous cell carcinoma: A prospective comparative study using propensity score matching. Am J Gastroenterol 2014; 109: 845-54.
Lee Y-C, Wang C-P, Chen C-C et al. Transnasal endoscopy with narrow-band imaging and Lugol staining to screen patients with head and neck cancer whose condition limits oral intubation with standard endoscope (with video). Gastrointest Endosc 2009; 69: 408-17.
Muto M, Minashi K, Yano T et al. Early detection of superficial squamous cell carcinoma in the head and neck region and esophagus by narrow band imaging: A multicenter randomized controlled trial. J Clin Oncol 2010; 28: 1566-72.
Ishihara R, Takeuchi Y, Chatani R et al. Prospective evaluation of narrow-band imaging endoscopy for screening of esophageal squamous mucosal high-grade neoplasia in experienced and less experienced endoscopists. Dis Esophagus 2010; 23: 480-6.
Tamashiro A, Yoshio T, Ishiyama A et al. Artificial intelligence-based detection of pharyngeal cancer using convolutional neural networks. Dig Endosc 2020; 32: 1057-65.
Kono M, Ishihara R, Kato Y et al. Diagnosis of pharyngeal cancer on endoscopic video images by Mask region-based convolutional neural network. Dig Endosc Published online: 26 Jul 2020; https://doi.org/10.1111/den.13800
Horie Y, Yoshio T, Aoyama K et al. Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest Endosc 2019; 89: 25-32.
Cai S-L, Li B, Tan W-M et al. Using a deep learning system in endoscopy for screening of early esophageal squamous cell carcinoma (with video). Gastrointest Endosc 2019; 90: : 745-53.e2.
Guo L, Xiao X, Wu C et al. Real-time automated diagnosis of precancerous lesions and early esophageal squamous cell carcinoma using a deep learning model (with videos). Gastrointest Endosc 2020; 91: 41-51.
Zhao Y-Y, Xue D-X, Wang Y-L et al. Computer-assisted diagnosis of early esophageal squamous cell carcinoma using narrow-band imaging magnifying endoscopy. Endoscopy 2019; 51: 333-41.
Nakagawa K, Ishihara R, Aoyama K et al. Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. Gastrointest Endosc 2019; 90: 407-14.
Tokai Y, Yoshio T, Aoyama K et al. Application of artificial intelligence using convolutional neural networks in determining the invasion depth of esophageal squamous cell carcinoma. Esophagus 2020; 17: 250-6.
Bray F, Ferlay J, Soerjomataram I et al. Global Cancer Statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2018; 68: 394-424.
Miyaki R, Yoshida S, Tanaka S et al. Quantitative identification of mucosal gastric cancer under magnifying endoscopy with flexible spectral imaging color enhancement. J Gastroenterol Hepatol 2013; 28: 841-7.
Miyaki R, Yoshida S, Tanaka S et al. A computer system to be used with laser-based endoscopy for quantitative diagnosis of early gastric cancer. J Clin Gastroenterol 2015; 49: 108-15.
Kanesaka T, Lee TC, Uedo N et al. Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. Gastrointest Endosc 2018; 87: 1339-44.
Hirasawa T, Aoyama K, Tanimoto T et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer 2018; 21: 653-60.
Horiuchi Y, Aoyama K, Tokai Y et al. Convolutional neural network for differentiating gastric cancer from gastritis using magnified endoscopy with narrow band imaging. Dig Dis Sci 2020; 65: 1355-63.
Li L, Chen Y, Shen Z et al. Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging. Gastric Cancer 2020; 23: 126-32.
Kubota K, Kuroda J, Misawa M et al. Medical image analysis: Computer-aided diagnosis of gastric cancer invasion on endoscopic images and other interventional techniques. Surg Endosc 2012; 26: 1485-9.
Zhu Y, Wang Q-C, Xu M-D et al. Application of convolutional neural network in the diagnosis of the invasion depth of gastric cancer based on conventional endoscopy. Gastrointest Endosc 2019; 89: 806-15.
Khan MA, Sharif M, Akram T et al. Stomach deformities recognition using rank-based deep features selection. J Med Syst 2019; 43: 329.
Xia J, Xia T, Pan J et al. Use of artificial intelligence for detection of gastric lesions by magnetically controlled capsule endoscopy. Gastrointest Endosc Published online: 26 May 2020; https://doi.org/10.1016/j.gie.2020.05.027
Namikawa K, Hirasawa T, Nakano K et al. Artificial intelligence-based diagnostic system classifying gastric cancers and ulcers: Comparison between the original and newly developed systems. Endoscopy 2020; 52: 1077-83.
Huang CR, Sheu BS, Chung PC et al. Computerized diagnosis of Helicobacter pylori infection and associated gastric inflammation from endoscopic images by refined feature selection using a neural network. Endoscopy 2004; 36: 601-8.
Shichijo S, Nomura S, Aoyama K et al. Application of convolutional neural networks in the diagnosis of Helicobacter pylori infection based on endoscopic images. EBioMedicine 2017; 25: 106-11.
Gulati S, Patel M, Emmanuel A et al. The future of endoscopy: Advances in endoscopic image innovations. Dig Endosc 2020; 32: 512-22.
Mohammadian T, Ganji L. The Diagnostic tests for detection of Helicobacter pylori infection. Monoclon Antib Immunodiagn Immunother 2019; 38: 1-7.
Itoh T, Kawahira H, Nakashima H et al. Deep learning analyzes Helicobacter pylori infection by upper gastrointestinal endoscopy images. Endosc Int Open 2018; 06: E139-44.
Nakashima H, Kawahira H, Kawachi H et al. Artificial intelligence diagnosis of Helicobacter pylori infection using blue laser imaging-bright and linked color imaging: A single-center prospective study. Ann Gastroenterol 2018; 31: 462-8.
Neumann H, Bisschops R. Artificial intelligence and the future of endoscopy. Dig Endosc 2019; 31: 389-90.
Zheng W, Zhang X, Kim JJ et al. High accuracy of convolutional neural network for evaluation of Helicobacter pylori infection based on endoscopic images: Preliminary experience. Clin Transl Gastroenterol 2019; 10: 1-6.
Wong GL-H, Ma AJ, Deng H et al. Machine learning model to predict recurrent ulcer bleeding in patients with history of idiopathic gastroduodenal ulcer bleeding. Aliment Pharmacol Ther 2019; 49: 912-8.
Cronin KA, Lake AJ, Scott S et al. Annual report to the nation on the status of cancer. Part I: National Cancer Statistics. Cancer 2018; 124: 2801-15.
Siegel RL, Miller KD, Fedewa SA et al. Colorectal cancer statistics, 2017. CA Cancer J Clin 2017; 67: 177-93.
Rex DK, Cutler CS, Lemmel GT et al. Colonoscopic miss rates of adenomas determined by back-to-back colonoscopies. Gastroenterology 1997; 112: 24-8.
Bisschops R, Tejpar S, Willekens H et al. Virtual chromoendoscopy (I-SCAN) detects more polyps in patients with Lynch syndrome: A randomized controlled crossover trial. Endoscopy 2017; 49: 342-50.
Omata F, Ohde S, Deshpande GA et al. Image-enhanced, chromo, and cap-assisted colonoscopy for improving adenoma/neoplasia detection rate: A systematic review and meta-analysis. Scand J Gastroenterol 2014; 49: 222-37.
Wada Y, Fukuda M, Ohtsuka K et al. Efficacy of Endocuff-assisted colonoscopy in the detection of colorectal polyps. Endosc Int Open 2018; 06: E425-31.
Atkinson NSS, Ket S, Bassett P et al. Narrow-band imaging for detection of neoplasia at colonoscopy: A meta-analysis of data from individual patients in randomized controlled trials. Gastroenterology 2019; 157: 462-71.
Hassan C, Senore C, Radaelli F et al. Full-spectrum (FUSE) versus standard forward-viewing colonoscopy in an organised colorectal cancer screening programme. Gut 2017; 66: 1949-55.
Mori Y, Kudo S, Berzin TM et al. Computer-aided diagnosis for colonoscopy. Endoscopy 2017; 49: 813-9.
Alagappan M, Glissen Brown JR, Mori Y et al. Artificial intelligence in gastrointestinal endoscopy: The future is almost here. World J Gastrointest Endosc 2018; 10: 239-49.
Liedlgruber M, Uhl A. Computer-aided decision support systems for endoscopy in the gastrointestinal tract: A review. IEEE Rev Biomed Eng 2011; 4: 73-88.
Karkanis SA, Iakovidis DK, Maroulis DE et al. Computer-aided tumor detection in endoscopic video using color wavelet features. IEEE Trans Inf Technol Biomed 2003; 7: 141-52.
Wang Y, Tavanapong W, Wong J et al. Polyp-alert: Near real-time feedback during colonoscopy. Comput Methods Programs Biomed 2015; 120: 164-79.
Angermann Q, Bernal J, Sánchez-Montes C et al. Towards real-time polyp detection in colonoscopy videos: Adapting still frame-based methodologies for video sequences analysis. In: MJ Cardoso, T Arbel, X Luo, eds. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Heidelberg, Berlin: Springer Verlag, 2017; 29-41.
Billah M, Waheed S, Rahman MM. An automatic gastrointestinal polyp detection system in video endoscopy using fusion of color wavelet and convolutional neural network features. Int J Biomed Imaging 2017; 2017: 1-17.
Zhang R, Zheng Y, Mak TWC et al. Automatic detection and classification of colorectal polyps by transferring low-level CNN features from nonmedical domain. IEEE J Biomed Heal Informatics 2017; 21: 41-7.
Klare P, Sander C, Prinzen M et al. Automated polyp detection in the colorectum: A prospective study (with videos). Gastrointest Endosc 2019; 89: 576-82.e1.
Wang P, Berzin TM, Romek Glissen Brown J et al. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: A prospective randomised controlled study. Gut 2019; 68: 1813-9.
Wang P, Liu X, Berzin TM et al. Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): A double-blind randomised study Articles Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy. Lancet Gastroenterol Hepatol 2020; 5: 343-51.
Hassan C, Wallace MB, Sharma P et al. New artificial intelligence system: First validation study versus experienced endoscopists for colorectal polyp detection. Gut 2020; 69: 799-800.
Repici A, Badalamenti M, Maselli R et al. Efficacy of real-time computer-aided detection of colorectal neoplasia in a randomized trial. Gastroenterology 2020; 159:512-20.e7
Kominami Y, Yoshida S, Tanaka S et al. Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. Gastrointest Endosc 2016; 83: 643-9.
Byrne MF, Chapados N, Soudan F et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 2019; 68: 94-100.
Takemura Y, Yoshida S, Tanaka S et al. Computer-aided system for predicting the histology of colorectal tumors by using narrow-band imaging magnifying colonoscopy (with video). Gastrointest Endosc 2012; 75: 179-85.
Komeda Y, Handa H, Watanabe T et al. Computer-aided diagnosis based on convolutional neural network system for colorectal polyp classification: Preliminary experience. Oncology 2017; 93: 30-4.
Sanchez-Montes C, Sanchez FJ, Bernal J et al. Computer-aided prediction of polyp histology on white light using surface pattern analysis. Endoscopy 2019; 51: 261-5.
Kudo S, Misawa M, Mori Y et al. Artificial intelligence-assisted system improves endoscopic identification of colorectal neoplasms. Clin Gastroenterol Hepatol 2020; 18: 1874-81.
Suykens J, Eelbode T, Daenen J et al. Sa2012 automated polyp size estimation with deep learning reduces interobserver variability. Gastrointest Endoscopy 2020; 91: AB241-2.
Saito H, Aoki T, Aoyama K et al. Automatic detection and classification of protruding lesions in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest Endosc 2020; 92: 44-151.e1.
Charisis VS, Hadjileontiadis Vasileios S, Charisis LJ, Hadjileontiadis LJ. Potential of hybrid adaptive filtering in inflammatory lesion detection from capsule endoscopy images. World J Gastroenterol 2016; 22: 8641-57.
Klang E, Barash Y, Yehuda Margalit R et al. Deep learning algorithms for automated detection of Crohn's disease ulcers by video capsule endoscopy. Gastrointest Endosc 2020; 91: 606-13.
Ozawa T, Ishihara S, Fujishiro M et al. Novel computer-assisted diagnosis system for endoscopic disease activity in patients with ulcerative colitis. Gastrointest Endosc 2019; 89: 416-21.e1.
Takenaka K, Ohtsuka K, Fujii T et al. Development and validation of a deep neural network for accurate evaluation of endoscopic images from patients with ulcerative colitis. Gastroenterology 2020; 158: 2150-7.
Bossuyt P, Nakase H, Vermeire S et al. Automatic, computer-aided determination of endoscopic and histological inflammation in patients with mild to moderate ulcerative colitis based on red density. Gut Published online: 8 Jan 2020; https://doi.org/10.1136/gutjnl-2019-320056
Maeda Y, Kudo S, Ogata N et al. Endocytoscopic intramucosal capillary network changes and crypt architecture abnormalities can predict relapse in patients with an ulcerative colitis Mayo endoscopic score of 1. Dig Endosc 2020; 32: 1082-91.
Waljee AK, Sauder K, Patel A et al. Machine learning algorithms for objective remission and clinical outcomes with thiopurines. J Crohn's Colitis 2017; 11: 801-10.
Waljee AK, Liu B, Sauder K et al. Predicting corticosteroid-free biologic remission with vedolizumab in Crohn's disease. Inflamm Bowel Dis 2018; 24: 1185-92.
Dong Y, Xu L, Fan Y et al. A novel surgical predictive model for Chinese Crohn's disease patients. Medicine 2019; 98: 1-10.
Jain S, Kedia S, Sethi T et al. Predictors of long-term outcomes in patients with acute severe colitis: A northern Indian cohort study. J Gastroenterol Hepatol 2018; 33: 615-22.
Ding Z, Shi H, Zhang H et al. Gastroenterologist-level identification of small-bowel diseases and normal variants by capsule endoscopy using a deep-learning model. Gastroenterology 2019; 157: 1044-54.
Aoki T, Yamada A, Aoyama K et al. Automatic detection of erosions and ulcerations in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest Endosc 2019; 89: 357-63.
Leenhardt R, Li C, Le Mouel J-P et al. CAD-CAP: A 25,000-image database serving the development of artificial intelligence for capsule endoscopy. Endosc Int Open 2020; 08: E415-20.
Otani K, Nakada A, Kurose Y et al. Automatic detection of small-bowel lesions on capsule endoscopy images using a newly developed deep convolutional neural network. Endoscopy 2020; 52: 786-91.
Wu L, Zhang J, Zhou W et al. Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy. Gut 2019; 68: 2161-9.
Chen D, Wu L, Li Y et al. Comparing blind spots of unsedated ultrafine, sedated, and unsedated conventional gastroscopy with and without artificial intelligence: A prospective, single-blind, 3-parallel-group, randomized, single-center trial. Gastrointest Endoscopy 2020; 91: 332-9.
Oh JH, Hwang S, Cao Y et al. Measuring objective quality of colonoscopy. IEEE Trans Biomed Eng 2009; 56: 2190-6.
Rey JF, Lambert R, Axon A et al. ESGE recommendations for quality control in gastrointestinal endoscopy: Guidelines for image documentation in upper and lower GI endoscopy. Endoscopy 2001; 33: 901-3.