Semi-supervised recognition for artificial intelligence assisted pathology image diagnosis.
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
20 Sep 2024
20 Sep 2024
Historique:
received:
28
04
2024
accepted:
20
08
2024
medline:
21
9
2024
pubmed:
21
9
2024
entrez:
20
9
2024
Statut:
epublish
Résumé
The analysis and interpretation of cytopathological images are crucial in modern medical diagnostics. However, manually locating and identifying relevant cells from the vast amount of image data can be a daunting task. This challenge is particularly pronounced in developing countries where there may be a shortage of medical expertise to handle such tasks. The challenge of acquiring large amounts of high-quality labelled data remains, many researchers have begun to use semi-supervised learning methods to learn from unlabeled data. Although current semi-supervised learning models partially solve the issue of limited labelled data, they are inefficient in exploiting unlabeled samples. To address this, we introduce a new AI-assisted semi-supervised scheme, the Reliable-Unlabeled Semi-Supervised Segmentation (RU3S) model. This model integrates the ResUNet-SE-ASPP-Attention (RSAA) model, which includes the Squeeze-and-Excitation (SE) network, Atrous Spatial Pyramid Pooling (ASPP) structure, Attention module, and ResUNet architecture. Our model leverages unlabeled data effectively, improving accuracy significantly. A novel confidence filtering strategy is introduced to make better use of unlabeled samples, addressing the scarcity of labelled data. Experimental results show a 2.0% improvement in mIoU accuracy over the current state-of-the-art semi-supervised segmentation model ST, demonstrating our approach's effectiveness in solving this medical problem.
Identifiants
pubmed: 39304708
doi: 10.1038/s41598-024-70750-7
pii: 10.1038/s41598-024-70750-7
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
21984Informations de copyright
© 2024. The Author(s).
Références
Isensee, F., Jaeger, P. F., Kohl, S. A., Petersen, J. & Maier-Hein, K. H. nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nat. Methods 18, 203–211 (2021).
pubmed: 33288961
doi: 10.1038/s41592-020-01008-z
Li, X. et al. H-denseunet: hybrid densely connected unet for liver and tumor segmentation from ct volumes. IEEE Trans. Med. Imaging 37, 2663–2674 (2018).
pubmed: 29994201
doi: 10.1109/TMI.2018.2845918
Neupane, B., Horanont, T. & Aryal, J. Deep learning-based semantic segmentation of urban features in satellite images: A review and meta-analysis. Remote Sensing 13, 808 (2021).
doi: 10.3390/rs13040808
Xie, X. et al. A survey on incorporating domain knowledge into deep learning for medical image analysis. Med. Image Anal. 69, 101985 (2021).
pubmed: 33588117
doi: 10.1016/j.media.2021.101985
Lv, L., Zhao, B., Kang, J., Li, S. & Wu, H. Trend of disease burden and risk factors of breast cancer in developing countries and territories, from 1990 to 2019: Results from the global burden of disease study 2019. Front. Public Health 10, 1078191 (2023).
pubmed: 36726635
pmcid: 9884979
doi: 10.3389/fpubh.2022.1078191
Wu, L. et al. Querying labeled for unlabeled: Cross-image semantic consistency guided semi-supervised semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence (2023).
Zhang, B. et al. Semi-supervised deep learning via transformation consistency regularization for remote sensing image semantic segmentation. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 16, 5782–5796 (2022).
doi: 10.1109/JSTARS.2022.3203750
Liang, Y. et al. Weakly supervised deep nuclei segmentation with sparsely annotated bounding boxes for DNA image cytometry. IEEE/ACM Trans. Comput. Biol. Bioinform. 20, 785–795 (2021).
doi: 10.1109/TCBB.2021.3138189
Foucart, A., Debeir, O. & Decaestecker, C. Shortcomings and areas for improvement in digital pathology image segmentation challenges. Comput. Med. Imaging Graph. 103, 102155 (2023).
pubmed: 36525770
doi: 10.1016/j.compmedimag.2022.102155
Zhou, X. et al. Emerging applications of deep learning in bone tumors: current advances and challenges. Front. Oncol. 12, 908873 (2022).
pubmed: 35928860
pmcid: 9345628
doi: 10.3389/fonc.2022.908873
Wu, J. et al. An artificial intelligence multiprocessing scheme for the diagnosis of osteosarcoma MRI images. IEEE J. Biomed. Health Inform. 26, 4656–4667 (2022).
pubmed: 35727772
doi: 10.1109/JBHI.2022.3184930
Li, X. et al. A comprehensive review of computer-aided whole-slide image analysis: From datasets to feature extraction, segmentation, classification and detection approaches. Artif. Intell. Rev. 55, 4809–4878 (2022).
doi: 10.1007/s10462-021-10121-0
Wu, J. et al. Research on artificial-intelligence-assisted medicine: A survey on medical artificial intelligence. Diagnostics 14, 1472. https://doi.org/10.1007/s40747-024-01471-7 (2024).
doi: 10.1007/s40747-024-01471-7
Van der Velden, B. H., Kuijf, H. J., Gilhuijs, K. G. & Viergever, M. A. Explainable artificial intelligence (xai) in deep learning-based medical image analysis. Med. Image Anal. 79, 102470 (2022).
pubmed: 35576821
doi: 10.1016/j.media.2022.102470
Chen, X. et al. Recent advances and clinical applications of deep learning in medical image analysis. Med. Image Anal. 79, 102444 (2022).
pubmed: 35472844
pmcid: 9156578
doi: 10.1016/j.media.2022.102444
Kora, P. et al. Transfer learning techniques for medical image analysis: A review. Biocybern. Biomed. Eng. 42, 79–107 (2022).
doi: 10.1016/j.bbe.2021.11.004
Xu, W., Fu, Y.-L. & Zhu, D. Resnet and its application to medical image processing: Research progress and challenges. Comput. Methods Programs Biomed. 240, 107660 (2023).
pubmed: 37320940
doi: 10.1016/j.cmpb.2023.107660
Yu, Z., Yu, L., Zheng, W. & Wang, S. Eiu-net: Enhanced feature extraction and improved skip connections in u-net for skin lesion segmentation. Comput. Biol. Med. 162, 107081 (2023).
pubmed: 37301097
doi: 10.1016/j.compbiomed.2023.107081
Jamali, A., Roy, S. K., Li, J. & Ghamisi, P. Transu-net++: Rethinking attention gated transu-net for deforestation mapping. Int. J. Appl. Earth Obs. Geoinf. 120, 103332 (2023).
Lv, H. et al. Attention mechanism in intelligent fault diagnosis of machinery: A review of technique and application. Measurement 199, 111594 (2022).
doi: 10.1016/j.measurement.2022.111594
Barrientos-Espillco, F., Gascó, E., López-González, C. I., Gómez-Silva, M. J. & Pajares, G. Semantic segmentation based on deep learning for the detection of cyanobacterial harmful algal blooms (cyanohabs) using synthetic images. Appl. Soft Comput. 141, 110315 (2023).
doi: 10.1016/j.asoc.2023.110315
Zhang, X., Cen, C., Li, F., Liu, M. & Mu, W. Crformer: Cross-resolution transformer for segmentation of grape leaf diseases with context mining. Expert Syst. Appl. 229, 120324 (2023).
doi: 10.1016/j.eswa.2023.120324
Santos, M. S. et al. On the joint-effect of class imbalance and overlap: A critical review. Artif. Intell. Rev. 55, 6207–6275 (2022).
doi: 10.1007/s10462-022-10150-3
Zou, Z., Chen, K., Shi, Z., Guo, Y. & Ye, J. Object detection in 20 years: A survey. Proc. IEEE 111, 257–276 (2023).
doi: 10.1109/JPROC.2023.3238524
AlAmir, M. & AlGhamdi, M. The role of generative adversarial network in medical image analysis: An in-depth survey. ACM Comput. Surv. 55, 1–36 (2022).
doi: 10.1145/3527849
Xu, Z. et al. Ambiguity-selective consistency regularization for mean-teacher semi-supervised medical image segmentation. Med. Image Anal. 88, 102880 (2023).
pubmed: 37413792
doi: 10.1016/j.media.2023.102880
Peng, X. et al. Adversarial domain adaptation network with mixmatch for incipient fault diagnosis of pmsm under multiple working conditions. Knowl. Based Syst. 284, 111331 (2024).
doi: 10.1016/j.knosys.2023.111331
Zhu, Y. et al. Improving semantic segmentation via efficient self-training. IEEE Trans. Pattern Anal. Mach. Intell. 46, 1589–1602 (2021).
doi: 10.1109/TPAMI.2021.3138337
Li, Y., Yao, H. & Xu, C. Test: Triplet ensemble student-teacher model for unsupervised person re-identification. IEEE Trans. Image Process. 30, 7952–7963 (2021).
pubmed: 34534083
doi: 10.1109/TIP.2021.3112039
Chen, T., Kornblith, S., Norouzi, M. & Hinton, G. A simple framework for contrastive learning of visual representations. In International conference on machine learning, 1597–1607 (PMLR, 2020).
He, K., Fan, H., Wu, Y., Xie, S. & Girshick, R. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 9729–9738 (2020).
Qi, G.-J. & Luo, J. Small data challenges in big data era: A survey of recent progress on unsupervised and semi-supervised methods. IEEE Trans. Pattern Anal. Mach. Intell. 44, 2168–2187 (2020).
doi: 10.1109/TPAMI.2020.3031898
Li, Z., Sun, Y., Zhang, L. & Tang, J. Ctnet: Context-based tandem network for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 44, 9904–9917 (2021).
doi: 10.1109/TPAMI.2021.3132068
Tang, X et al. Artificial intelligence multiprocessing scheme for pathology images based on transformer for nuclei segmentation. Complex Intell. Syst. (2024). https://doi.org/10.1007/s40747-024-01471-7.
pubmed: 33158870
pmcid: 7673716
doi: 10.1126/sciadv.abd0384
Li, Z., Li, Q., Zou, X. & Ren, J. Causality extraction based on self-attentive bilstm-crf with transferred embeddings. Neurocomputing 423, 207–219 (2021).
doi: 10.1016/j.neucom.2020.08.078
Chen, S., Gamechi, Z. S., Dubost, F., van Tulder, G. & de Bruijne, M. An end-to-end approach to segmentation in medical images with cnn and posterior-crf. Med. Image Anal. 76, 102311 (2022).
pubmed: 34902793
doi: 10.1016/j.media.2021.102311
Li, C. et al. Underwater image enhancement via medium transmission-guided multi-color space embedding. IEEE Trans. Image Process. 30, 4985–5000 (2021).
pubmed: 33961554
doi: 10.1109/TIP.2021.3076367
Rahman, T. et al. Exploring the effect of image enhancement techniques on covid-19 detection using chest x-ray images. Comput. Biol. Med. 132, 104319 (2021).
pubmed: 33799220
pmcid: 7946571
doi: 10.1016/j.compbiomed.2021.104319
Littlejohns, T. J. et al. The UK biobank imaging enhancement of 100,000 participants: Rationale, data collection, management and future directions. Nat. Commun. 11, 2624 (2020).
pubmed: 32457287
pmcid: 7250878
doi: 10.1038/s41467-020-15948-9
Bronskill, J., Gordon, J., Requeima, J., Nowozin, S. & Turner, R. Tasknorm: Rethinking batch normalization for meta-learning. In International Conference on Machine Learning, 1153–1164 (PMLR, 2020).
Jin, X. et al. Delving deep into spatial pooling for squeeze-and-excitation networks. Pattern Recognit. 121, 108159 (2022).
doi: 10.1016/j.patcog.2021.108159
Li, Y. et al. Epileptic seizure detection in eeg signals using a unified temporal-spectral squeeze-and-excitation network. IEEE Trans. Neural Syst. Rehabil. Eng. 28, 782–794 (2020).
pubmed: 32078551
doi: 10.1109/TNSRE.2020.2973434
Galassi, A., Lippi, M. & Torroni, P. Attention in natural language processing. IEEE Trans. Neural Netw. Learn. Syst. 32, 4291–4308 (2020).
doi: 10.1109/TNNLS.2020.3019893
Niu, Z., Zhong, G. & Yu, H. A review on the attention mechanism of deep learning. Neurocomputing 452, 48–62 (2021).
doi: 10.1016/j.neucom.2021.03.091
Chen, X., Yuan, Y., Zeng, G. & Wang, J. Semi-supervised semantic segmentation with cross pseudo supervision. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2613–2622 (2021).
Ouali, Y., Hudelot, C. & Tami, M. Semi-supervised semantic segmentation with cross-consistency training. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 12674–12684 (2020).
Zhang, S.-X., Zhu, X., Chen, L., Hou, J.-B. & Yin, X.-C. Arbitrary shape text detection via segmentation with probability maps. IEEE Trans. Pattern Anal. Mach. Intell. 45, 2736–2750 (2022).
Kim, W., Kanezaki, A. & Tanaka, M. Unsupervised learning of image segmentation based on differentiable feature clustering. IEEE Trans. Image Process. 29, 8055–8068 (2020).
doi: 10.1109/TIP.2020.3011269
Hung, W.-C., Tsai, Y.-H., Liou, Y.-T., Lin, Y.-Y. & Yang, M.-H. Adversarial learning for semi-supervised semantic segmentation. arXiv preprint arXiv:1802.07934 (2018).
Lai, X. et al. Semi-supervised semantic segmentation with directional context-aware consistency. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1205–1214 (2021).
Wang, L. & Yoon, K.-J. Semi-supervised student–teacher learning for single image super-resolution. Pattern Recognit. 121, 108206 (2022).
doi: 10.1016/j.patcog.2021.108206
Feng, Z. et al. Dmt: Dynamic mutual training for semi-supervised learning. Pattern Recognit. 130, 108777 (2022).
doi: 10.1016/j.patcog.2022.108777
Liu, S., Zhi, S., Johns, E. & Davison, A. J. Bootstrapping semantic segmentation with regional contrast. arXiv preprint arXiv:2104.04465 (2021).