Spectrum aided vision enhancer enhances mucosal visualization by hyperspectral imaging in capsule endoscopy.
Capsule endoscopy
Gastroesophageal reflux disorder
Hyperspectral imaging
Image enhancing
SAVE
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
27 Sep 2024
27 Sep 2024
Historique:
received:
06
04
2024
accepted:
17
09
2024
medline:
28
9
2024
pubmed:
28
9
2024
entrez:
27
9
2024
Statut:
epublish
Résumé
Narrow-band imaging (NBI) is more efficient in detecting early gastrointestinal cancer than white light imaging (WLI). NBI technology is available only in conventional endoscopy, but unavailable in magnetic-assisted capsule endoscopy (MACE) systems due to MACE's small size and obstacles in image processing issues. MACE is an easy, safe, and convenient tool for both patients and physicians to avoid the disadvantages of conventional endoscopy. Enabling NBI technology in MACE is mandatory. We developed a novel method to improve mucosal visualization using hyperspectral imaging (HSI) known as Spectrum Aided Visual Enhancer (SAVE, Transfer N, Hitspectra Intelligent Technology Co., Kaohsiung, Taiwan). The technique was developed by converting the WLI image captured by MACE to enhance SAVE images. The structural similarity index metric (SSIM) between the WLI MACE images and the enhanced SAVE images was 91%, while the entropy difference between the WLI MACE images and the enhanced SAVE images was only 0.47%. SAVE algorithm can identify the mucosal break on the esophagogastric junction in patients with gastroesophageal reflux disorder. We successfully developed a novel image-enhancing technique, SAVE, in the MACE system, showing close similarity to the NBI from the conventional endoscopy system. The future application of this novel technology in the MACE system can be promising.
Identifiants
pubmed: 39333620
doi: 10.1038/s41598-024-73387-8
pii: 10.1038/s41598-024-73387-8
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
22243Subventions
Organisme : Taipei Veterans General Hospital
ID : V112C-151
Organisme : National Science and Technology Council
ID : NSTC 112-2221-E-194-036 and NSTC 112-2222-E-194-002
Informations de copyright
© 2024. The Author(s).
Références
Sano, Y. et al. Narrow-band imaging (NBI) magnifying endoscopic classification of colorectal tumors proposed by the Japan NBI Expert Team. Dig. Endosc. 28, 526–533 (2016).
doi: 10.1111/den.12644
Kominami, Y. et al. Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. Gastrointest. Endosc. 83, 643–649 (2016).
doi: 10.1016/j.gie.2015.08.004
Rees, C. J. et al. Narrow band imaging optical diagnosis of small colorectal polyps in routine clinical practice: the detect inspect characterise resect and discard 2 (DISCARD 2) study. Gut 66, 887–895 (2017).
doi: 10.1136/gutjnl-2015-310584
Saka, A., Yagi, K. & Nimura, S. OLGA-and OLGIM‐based staging of gastritis using narrow‐band imaging magnifying endoscopy. Dig. Endosc. 27, 735–742 (2015).
doi: 10.1111/den.12483
Ye, Z. et al. A comparison of NBI and WLI cystoscopy in detecting non-muscle-invasive bladder cancer: a prospective, randomized and multi-center study. Sci. Rep. 5, 10905 (2015).
doi: 10.1038/srep10905
Wang, Y., Huang, Y. Y., Wang, Y., Lyu, P. & Hamblin, M. R. Red (660 nm) or near-infrared (810 nm) photobiomodulation stimulates, while blue (415 nm), green (540 nm) light inhibits proliferation in human adipose-derived stem cells. Sci. Rep. 7, 7781 (2017).
doi: 10.1038/s41598-017-07525-w
Song, L. M. W. K. et al. Narrow band imaging and multiband imaging. Gastrointest. Endosc. 67, 581–589 (2008).
doi: 10.1016/j.gie.2008.01.013
Gono, K. et al. Endoscopic observation of tissue by narrowband illumination. Opt. Rev. 10, 211–215 (2003).
doi: 10.1007/s10043-003-0211-8
Yao, K. et al. Clinical application of magnification endoscopy and narrow-band imaging in the upper gastrointestinal tract: new imaging techniques for detecting and characterizing gastrointestinal neoplasia. Gastrointest. Endosc. Clin. N. Am. 18, 415–433 (2008).
doi: 10.1016/j.giec.2008.05.011
Nagorni, A., Bjelakovic, G. & Petrovic, B. Narrow band imaging versus conventional white light colonoscopy for the detection of colorectal polyps. Cochrane Database Syst. Rev. (2012).
Muto, M. et al. Narrow-band imaging of the gastrointestinal tract. J. Gastroenterol. 44, 13 (2009).
doi: 10.1007/s00535-008-2291-5
Yoshida, T. et al. Narrow-band imaging system with magnifying endoscopy for superficial esophageal lesions. Gastrointest. Endosc. 59, 288–295 (2004).
doi: 10.1016/S0016-5107(03)02532-X
Zhang, Q. et al. Comparison of the diagnostic efficacy of white light endoscopy and magnifying endoscopy with narrow band imaging for early gastric cancer: a meta-analysis. Gastric Cancer 19, 543–552 (2016).
doi: 10.1007/s10120-015-0500-5
Costamagna, G. et al. A prospective trial comparing small bowel radiographs and video capsule endoscopy for suspected small bowel disease. Gastroenterology 123, 999–1005 (2002).
doi: 10.1053/gast.2002.35988
Pennazio, M., Rondonotti, E. & de Franchis, R. Capsule endoscopy in neoplastic diseases. World J. Gastroenterol. 14, 5245 (2008).
doi: 10.3748/wjg.14.5245
Carpi, F., Galbiati, S. & Carpi, A. Magnetic shells for gastrointestinal endoscopic capsules as a means to control their motion. Biomed. Pharmacother. 60, 370–374 (2006).
doi: 10.1016/j.biopha.2006.07.001
Kim, S. H. & Chun, H. J. Capsule Endoscopy: pitfalls and approaches to overcome. Diagnostics 11, 1765 (2021).
doi: 10.3390/diagnostics11101765
Zhang, Y., Zhang, Y. & Huang, X. Development and application of magnetically controlled Capsule Endoscopy in detecting gastric lesions. Gastroenterol. Res. Pract. 2021 (2716559). https://doi.org/10.1155/2021/2716559 (2021).
Sahafi, A. et al. Edge artificial intelligence wireless video capsule endoscopy. Sci. Rep. 12, 13723. https://doi.org/10.1038/s41598-022-17502-7 (2022).
doi: 10.1038/s41598-022-17502-7
Yen, C. T., Lai, Z. W., Lin, Y. T. & Cheng, H. C. Optical design with narrow-band imaging for a capsule endoscope. J. Healthc. Eng. 2018 (5830759). https://doi.org/10.1155/2018/5830759 (2018).
Graepler, F., Wolter, M., Vonthein, R. & Gregor, M. Accuracy of the size estimation in wireless capsule endoscopy: calibrating the M2A PillCam (with video). Gastrointest. Endosc. 67, 924–931 (2008).
doi: 10.1016/j.gie.2007.10.060
Zhou, M., Bao, G., Geng, Y., Alkandari, B. & Li, X. 7th International Conference on Biomedical Engineering and Informatics 237–241 (IEEE, 2014).
Lu, G. & Fei, B. Medical hyperspectral imaging: a review. J. Biomed. Opt. 19, 010901 (2014).
doi: 10.1117/1.JBO.19.1.010901
ElMasry, G. & Sun, D. W. Hyperspectral Imaging for Food Quality Analysis and Control 3–43 (Elsevier, 2010).
Lu, B., Dao, P. D., Liu, J., He, Y. & Shang, J. Recent advances of hyperspectral imaging technology and applications in agriculture. Remote Sens. 12, 2659 (2020).
doi: 10.3390/rs12162659
Ozdemir, A. & Polat, K. Deep learning applications for hyperspectral imaging: a systematic review. J. Inst. Electron. Comput. 2, 39–56 (2020).
doi: 10.33969/JIEC.2020.21004
Ravikanth, L., Jayas, D. S., White, N. D., Fields, P. G. & Sun, D. W. Extraction of spectral information from hyperspectral data and application of hyperspectral imaging for food and agricultural products. Food Bioprocess Technol. 10, 1–33 (2017).
doi: 10.1007/s11947-016-1817-8
Alhayani, B. & Ilhan, H. Hyper spectral image classification using dimensionality reduction techniques. Int. J. Innov. Res. Electr. Electron. Instrum. Control Eng. 5, 71–74 (2017).
Mukundan, A., Hong-Thai, N. & Wang, H. C. Proceedings of the Conference on Lasers and Electro-Optics Pacific Rim, CPDP_08 (Optica Publishing Group) (2022).
Mukundan, A., Huang, C. C., Men, T. C., Lin, F. C. & Wang, H. C. Air pollution detection using a novel snap-shot hyperspectral imaging technique. Sensors 22, 6231 (2022).
doi: 10.3390/s22166231
Wang, C. et al. A review of deep learning used in the hyperspectral image analysis for agriculture. Artif. Intell. Rev. 54, 5205–5253 (2021).
doi: 10.1007/s10462-021-10018-y
Khan, A., Vibhute, A. D., Mali, S. & Patil, C. A systematic review on hyperspectral imaging technology with a machine and deep learning methodology for agricultural applications. Ecol. Inf. 101678 (2022).
Mukundan, A. & Wang, H. C. The Brahmavarta initiative: a Roadmap for the first self-sustaining city-state on mars. Universe 8, 550 (2022).
doi: 10.3390/universe8110550
Mukundan, A. et al. The Dvaraka initiative: Mars’s first permanent human settlement capable of self-sustenance. Aerospace 10, 265 (2023).
Mukundan, A. & Wang, H. C. AIAA SCITECH 2023 Forum (1603).
Fang, Y. J., Mukundan, A., Tsao, Y. M., Huang, C. W. & Wang, H. C. Identification of early esophageal cancer by semantic segmentation. J. Person. Med. 12, 1204 (2022).
doi: 10.3390/jpm12081204
Huang, H. Y. et al. Classification of skin cancer using novel hyperspectral imaging engineering via YOLOv5. J. Clin. Med. 12, 1134 (2023).
doi: 10.3390/jcm12031134
Tsai, T. J. et al. Intelligent identification of early esophageal cancer by band-selective hyperspectral imaging. Cancers 14, 4292 (2022).
doi: 10.3390/cancers14174292
Lypaczewski, P. et al. Characterization of mineralogy in the highland valley porphyry Cu district using hyperspectral imaging, and potential applications. Minerals 10, 473 (2020).
doi: 10.3390/min10050473
Thannoun, R. G. Mapping lithological and mineralogical units using hyperspectral imagery. Malays. J. Sci., 93–106 (2021).
Mukundan, A. et al. Optical and material characteristics of MoS2/Cu2O sensor for detection of lung cancer cell types in hydroplegia. Int. J. Mol. Sci. 23, 4745 (2022).
doi: 10.3390/ijms23094745
Mukundan, A., Tsao, Y. M., Artemkina, S. B., Fedorov, V. E. & Wang, H. C. Growth mechanism of periodic-structured MoS2 by transmission electron microscopy. Nanomaterials 12, 135 (2022).
Hsiao, Y. P. et al. Design of a lab-on-chip for cancer cell detection through impedance and photoelectrochemical response analysis. Biosensors 12, 405 (2022).
Gawad, A. L. A., El-Sharkawy, Y., Ayoub, H., El-Sherif, A. F. & Hassan, M. F. Classification of dental diseases using hyperspectral imaging and laser induced fluorescence. Photodiagn. Photodyn. Ther. 25, 128–135 (2019).
doi: 10.1016/j.pdpdt.2018.11.017
Tejada-Casado, M. et al. Validation of a hyperspectral imaging system for color measurement of in-vivo dental structures. Micromachines 13, 1929 (2022).
doi: 10.3390/mi13111929
Huang, S. Y. et al. Recent advances in counterfeit art, document, photo, hologram, and currency detection using hyperspectral imaging. Sensors 22, 7308 (2022).
doi: 10.3390/s22197308
Mukundan, A., Tsao, Y. M., Lin, F. C. & Wang, H. C. Portable and low-cost hologram verification module using a snapshot-based hyperspectral imaging algorithm. Sci. Rep. 12, 18475. https://doi.org/10.1038/s41598-022-22424-5 (2022).
doi: 10.1038/s41598-022-22424-5
Mukundan, A., Tsao, Y. M., Cheng, W. M., Lin, F. C. & Wang, H. C. Automatic counterfeit currency detection using a novel snapshot hyperspectral imaging algorithm. Sensors 23, 2026 (2023).
doi: 10.3390/s23042026
Reshef, E. R., Miller, J. B. & Vavvas, D. G. Hyperspectral imaging of the retina: a review. Int. Ophthalmol. Clin. 60, 85–96 (2020).
doi: 10.1097/IIO.0000000000000293
Hadoux, X. et al. Non-invasive in vivo hyperspectral imaging of the retina for potential biomarker use in Alzheimer’s disease. Nat. Commun. 10, 4227 (2019).
doi: 10.1038/s41467-019-12242-1
Signoroni, A., Savardi, M., Baronio, A. & Benini, S. Deep learning meets hyperspectral image analysis: a multidisciplinary review. J. Imaging 5 (2019).
Khan, M. J., Khan, H. S., Yousaf, A., Khurshid, K. & Abbas, A. Modern trends in hyperspectral image analysis: a review. IEEE Access 6, 14118–14129. https://doi.org/10.1109/ACCESS.2018.2812999 (2018).
doi: 10.1109/ACCESS.2018.2812999
Sara, U., Akter, M. & Uddin, M. S. Image quality assessment through FSIM, SSIM, MSE and PSNR—a comparative study. J. Comput. Commun. 7, 8–18 (2019).
doi: 10.4236/jcc.2019.73002
Bakurov, I., Buzzelli, M., Schettini, R., Castelli, M. & Vanneschi, L. Structural similarity index (SSIM) revisited: a data-driven approach. Expert Syst. Appl. 189, 116087 (2022).
doi: 10.1016/j.eswa.2021.116087
Setiadi, D. R. I. M. PSNR vs SSIM: imperceptibility quality assessment for image steganography. Multimedia Tools Appl. 80, 8423–8444 (2021).
doi: 10.1007/s11042-020-10035-z
Wu, Y. et al. Local Shannon entropy measure with statistical tests for image randomness. Inf. Sci. 222, 323–342 (2013).
doi: 10.1016/j.ins.2012.07.049
Wu, Y., Noonan, J. P. & Agaian, S. Shannon entropy based randomness measurement and test for image encryption. Preprint at http://arXiv.org/1103.5520 (2011).
Poobathy, D. & Chezian, R. M. Edge detection operators: peak signal to noise ratio based comparison. IJ Image Graph. Signal. Process. 10, 55–61 (2014).
doi: 10.5815/ijigsp.2014.10.07
Nevriyanto, A., Sutarno, S., Siswanti, S. D. & Erwin, E. International Conference on Electrical Engineering and Computer Science (ICECOS) 147–152 (2018).
Zhou, F. et al. The accuracy of magnifying narrow band imaging (ME-NBI) in distinguishing between cancerous and noncancerous gastric lesions: a meta-analysis. Medicine 97 (2018).
Kellerman, R. & Kintanar, T. Gastroesophageal reflux disease. Prim. Care Clin. Office Pract. 44, 561–573 (2017).
doi: 10.1016/j.pop.2017.07.001
Ruigómez, A., Wallander, M. A., Lundborg, P., Johansson, S. & Rodriguez, L. A. G. Gastroesophageal reflux disease in children and adolescents in primary care. Scand. J. Gastroenterol. 45, 139–146 (2010).
doi: 10.3109/00365520903428606
Huang, F. L. & Yu, S. J. Esophageal cancer: risk factors, genetic association, and treatment. Asian J. Surg. 41, 210–215 (2018).
doi: 10.1016/j.asjsur.2016.10.005
Tsai, C. L. et al. Hyperspectral imaging combined with artificial intelligence in the early detection of esophageal cancer. Cancers 13, 4593 (2021).
doi: 10.3390/cancers13184593
Short, M. W., Burgers, K. G. & Fry, V. T. Esophageal cancer. Am. Fam. Phys. 95, 22–28 (2017).
Lee, Y. C. et al. Intraobserver and interobserver consistency for grading esophagitis with narrow-band imaging. Gastrointest. Endosc. 66, 230–236. https://doi.org/10.1016/j.gie.2006.10.056 (2007).
doi: 10.1016/j.gie.2006.10.056