Machine learning techniques for mitoses classification.
Convolutional neural networks
Machine learning
Melanoma
Mitoses
Pathology
Journal
Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society
ISSN: 1879-0771
Titre abrégé: Comput Med Imaging Graph
Pays: United States
ID NLM: 8806104
Informations de publication
Date de publication:
01 2021
01 2021
Historique:
received:
01
01
2020
revised:
09
10
2020
accepted:
17
11
2020
pubmed:
11
12
2020
medline:
26
10
2021
entrez:
10
12
2020
Statut:
ppublish
Résumé
Pathologists analyze biopsy material at both the cellular and structural level to determine diagnosis and cancer stage. Mitotic figures are surrogate biomarkers of cellular proliferation that can provide prognostic information; thus, their precise detection is an important factor for clinical care. Convolutional Neural Networks (CNNs) have shown remarkable performance on several recognition tasks. Utilizing CNNs for mitosis classification may aid pathologists to improve the detection accuracy. We studied two state-of-the-art CNN-based models, ESPNet and DenseNet, for mitosis classification on six whole slide images of skin biopsies and compared their quantitative performance in terms of sensitivity, specificity, and F-score. We used raw RGB images of mitosis and non-mitosis samples with their corresponding labels as training input. In order to compare with other work, we studied the performance of these classifiers and two other architectures, ResNet and ShuffleNet, on the publicly available MITOS breast biopsy dataset and compared the performance of all four in terms of precision, recall, and F-score (which are standard for this data set), architecture, training time and inference time. The ESPNet and DenseNet results on our primary melanoma dataset had a sensitivity of 0.976 and 0.968, and a specificity of 0.987 and 0.995, respectively, with F-scores of .968 and .976, respectively. On the MITOS dataset, ESPNet and DenseNet showed a sensitivity of 0.866 and 0.916, and a specificity of 0.973 and 0.980, respectively. The MITOS results using DenseNet had a precision of 0.939, recall of 0.916, and F-score of 0.927. The best published result on MITOS (Saha et al. 2018) reported precision of 0.92, recall of 0.88, and F-score of 0.90. In our architecture comparisons on MITOS, we found that DenseNet beats the others in terms of F-Score (DenseNet 0.927, ESPNet 0.890, ResNet 0.865, ShuffleNet 0.847) and especially Recall (DenseNet 0.916, ESPNet 0.866, ResNet 0.807, ShuffleNet 0.753), while ResNet and ESPNet have much faster inference times (ResNet 6 s, ESPNet 8 s, DenseNet 31 s). ResNet is faster than ESPNet, but ESPNet has a higher F-Score and Recall than ResNet, making it a good compromise solution. We studied several state-of-the-art CNNs for detecting mitotic figures in whole slide biopsy images. We evaluated two CNNs on a melanoma cancer dataset and then compared four CNNs on a public breast cancer data set, using the same methodology on both. Our methodology and architecture for mitosis finding in both melanoma and breast cancer whole slide images has been thoroughly tested and is likely to be useful for finding mitoses in any whole slide biopsy images.
Sections du résumé
BACKGROUND
Pathologists analyze biopsy material at both the cellular and structural level to determine diagnosis and cancer stage. Mitotic figures are surrogate biomarkers of cellular proliferation that can provide prognostic information; thus, their precise detection is an important factor for clinical care. Convolutional Neural Networks (CNNs) have shown remarkable performance on several recognition tasks. Utilizing CNNs for mitosis classification may aid pathologists to improve the detection accuracy.
METHODS
We studied two state-of-the-art CNN-based models, ESPNet and DenseNet, for mitosis classification on six whole slide images of skin biopsies and compared their quantitative performance in terms of sensitivity, specificity, and F-score. We used raw RGB images of mitosis and non-mitosis samples with their corresponding labels as training input. In order to compare with other work, we studied the performance of these classifiers and two other architectures, ResNet and ShuffleNet, on the publicly available MITOS breast biopsy dataset and compared the performance of all four in terms of precision, recall, and F-score (which are standard for this data set), architecture, training time and inference time.
RESULTS
The ESPNet and DenseNet results on our primary melanoma dataset had a sensitivity of 0.976 and 0.968, and a specificity of 0.987 and 0.995, respectively, with F-scores of .968 and .976, respectively. On the MITOS dataset, ESPNet and DenseNet showed a sensitivity of 0.866 and 0.916, and a specificity of 0.973 and 0.980, respectively. The MITOS results using DenseNet had a precision of 0.939, recall of 0.916, and F-score of 0.927. The best published result on MITOS (Saha et al. 2018) reported precision of 0.92, recall of 0.88, and F-score of 0.90. In our architecture comparisons on MITOS, we found that DenseNet beats the others in terms of F-Score (DenseNet 0.927, ESPNet 0.890, ResNet 0.865, ShuffleNet 0.847) and especially Recall (DenseNet 0.916, ESPNet 0.866, ResNet 0.807, ShuffleNet 0.753), while ResNet and ESPNet have much faster inference times (ResNet 6 s, ESPNet 8 s, DenseNet 31 s). ResNet is faster than ESPNet, but ESPNet has a higher F-Score and Recall than ResNet, making it a good compromise solution.
CONCLUSION
We studied several state-of-the-art CNNs for detecting mitotic figures in whole slide biopsy images. We evaluated two CNNs on a melanoma cancer dataset and then compared four CNNs on a public breast cancer data set, using the same methodology on both. Our methodology and architecture for mitosis finding in both melanoma and breast cancer whole slide images has been thoroughly tested and is likely to be useful for finding mitoses in any whole slide biopsy images.
Identifiants
pubmed: 33302246
pii: S0895-6111(20)30127-0
doi: 10.1016/j.compmedimag.2020.101832
pmc: PMC7855641
mid: NIHMS1653021
pii:
doi:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
101832Subventions
Organisme : NCI NIH HHS
ID : R01 CA200690
Pays : United States
Organisme : NCI NIH HHS
ID : U01 CA231782
Pays : United States
Commentaires et corrections
Type : ErratumIn
Informations de copyright
Copyright © 2020 Elsevier Ltd. All rights reserved.
Références
Med Image Anal. 2015 Feb;20(1):237-48
pubmed: 25547073
J Am Acad Dermatol. 2014 Jan;70(1):131-41
pubmed: 24176521
J Clin Oncol. 2011 Jun 1;29(16):2199-205
pubmed: 21519009
Med Image Comput Comput Assist Interv. 2013;16(Pt 2):411-8
pubmed: 24579167
Annu Int Conf IEEE Eng Med Biol Soc. 2009;2009:1433-6
pubmed: 19963746
Sci Rep. 2018 Mar 15;8(1):4165
pubmed: 29545529
Annu Int Conf IEEE Eng Med Biol Soc. 2013;2013:6091-4
pubmed: 24111129
JAMA. 2015 Mar 17;313(11):1122-32
pubmed: 25781441
Cell. 2018 Feb 22;172(5):1122-1131.e9
pubmed: 29474911
J Am Acad Dermatol. 2014 Dec;71(6):1204-11
pubmed: 25239732
J Pathol Inform. 2013 May 30;4:8
pubmed: 23858383
JAMA Netw Open. 2019 Aug 2;2(8):e198777
pubmed: 31397859
Comput Med Imaging Graph. 2018 Mar;64:29-40
pubmed: 29409716
Nature. 2017 Feb 2;542(7639):115-118
pubmed: 28117445
Cancer Res. 2017 Nov 1;77(21):e83-e86
pubmed: 29092947
Med Image Anal. 2018 Apr;45:121-133
pubmed: 29455111
BMJ. 2017 Jun 28;357:j2813
pubmed: 28659278