Automatic Whole Slide Pathology Image Diagnosis Framework via Unit Stochastic Selection and Attention Fusion.

Whole slide image attention fusion computer-aided diagnosis stochastic selection units of interest

Journal

Neurocomputing
ISSN: 0925-2312
Titre abrégé: Neurocomputing (Amst)
Pays: Netherlands
ID NLM: 9884927

Informations de publication

Date de publication:
17 Sep 2021
Historique:
entrez: 27 1 2022
pubmed: 28 1 2022
medline: 28 1 2022
Statut: ppublish

Résumé

Pathology tissue slides are taken as the gold standard for the diagnosis of most cancer diseases. Automatic pathology slide diagnosis is still a challenging task for researchers because of the high-resolution, significant morphological variation, and ambiguity between malignant and benign regions in whole slide images (WSIs). In this study, we introduce a general framework to automatically diagnose different types of WSIs via unit stochastic selection and attention fusion. For example, a unit can denote a patch in a histopathology slide or a cell in a cytopathology slide. To be specific, we first train a unit-level convolutional neural network (CNN) to perform two tasks: constructing feature extractors for the units and for estimating a unit's non-benign probability. Then we use our novel stochastic selection algorithm to choose a small subset of units that are most likely to be non-benign, referred to as the Units Of Interest (UOI), as determined by the CNN. Next, we use the attention mechanism to fuse the representations of the UOI to form a fixed-length descriptor for the WSI's diagnosis. We evaluate the proposed framework on three datasets: histological thyroid frozen sections, histological colonoscopy tissue slides, and cytological cervical pap smear slides. The framework achieves diagnosis accuracies higher than 0.8 and AUC values higher than 0.85 in all three applications. Experiments demonstrate the generality and effectiveness of the proposed framework and its potentiality for clinical applications.

Identifiants

pubmed: 35082453
doi: 10.1016/j.neucom.2020.04.153
pmc: PMC8786216
mid: NIHMS1667698
doi:

Types de publication

Journal Article

Langues

eng

Pagination

312-325

Subventions

Organisme : NIAMS NIH HHS
ID : R01 AR065479
Pays : United States

Déclaration de conflit d'intérêts

Conflict of interests The authors declare no conflicts of interest.

Références

IEEE Rev Biomed Eng. 2014;7:97-114
pubmed: 24802905
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2016 Jun-Jul;2016:2424-2433
pubmed: 27795661
BMJ. 2017 Jun 28;357:j2813
pubmed: 28659278
IEEE Trans Pattern Anal Mach Intell. 2017 Apr;39(4):640-651
pubmed: 27244717
IEEE Trans Inf Technol Biomed. 2011 Mar;15(2):233-41
pubmed: 20952343
Med Image Comput Comput Assist Interv. 2018 Sep;11071:201-209
pubmed: 30465047
PLoS One. 2014 Dec 09;9(12):e114885
pubmed: 25490766
IEEE Trans Biomed Eng. 2016 Jul;63(7):1455-62
pubmed: 26540668
Int J Cancer. 2000 May 1;86(3):429-35
pubmed: 10760834
IEEE Trans Cybern. 2020 Sep;50(9):3950-3962
pubmed: 31484154
IEEE Trans Med Imaging. 2015 Feb;34(2):496-506
pubmed: 25314696
J Obstet Gynaecol Can. 2006 Dec;28(12):1095-1098
pubmed: 17169233
Nat Biomed Eng. 2017 Jul;1(7):
pubmed: 29750130
J Pathol Inform. 2018 Nov 14;9:38
pubmed: 30607305
IEEE Trans Pattern Anal Mach Intell. 2017 Jun;39(6):1137-1149
pubmed: 27295650
IEEE Trans Biomed Eng. 2014 May;61(5):1400-11
pubmed: 24759275
Med Image Comput Comput Assist Interv. 2013;16(Pt 2):411-8
pubmed: 24579167
Annu Rev Biomed Eng. 2017 Jun 21;19:221-248
pubmed: 28301734
Nat Med. 2019 Aug;25(8):1301-1309
pubmed: 31308507
IEEE Trans Biomed Eng. 2012 Mar;59(3):754-65
pubmed: 22167559
Mycoses. 2015 Jan;58(1):27-32
pubmed: 25346218
Ann Surg Oncol. 2015 Jan;22(1):152-7
pubmed: 25074665
Cancer. 1997 Feb 15;79(4):665-7
pubmed: 9024702
AJR Am J Roentgenol. 2004 Oct;183(4):1149-57
pubmed: 15385322
J Open Source Softw. 2019;4(33):
pubmed: 36204448
Med Image Anal. 2019 Dec;58:101549
pubmed: 31499320
Med Image Anal. 2017 Dec;42:60-88
pubmed: 28778026
BMC Bioinformatics. 2017 May 26;18(1):281
pubmed: 28549410
Comput Struct Biotechnol J. 2018 Feb 09;16:34-42
pubmed: 30275936
IEEE Trans Neural Netw Learn Syst. 2019 Nov;30(11):3484-3495
pubmed: 30794190
Acta Cytol. 2000 Sep-Oct;44(5):726-42
pubmed: 11015972

Auteurs

Pingjun Chen (P)

J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida.

Yun Liang (Y)

J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida.

Xiaoshuang Shi (X)

J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida.

Lin Yang (L)

J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida.

Paul Gader (P)

Computer and Information Science and Engineering, University of Florida.

Classifications MeSH