Machine learning techniques for mitoses classification.

Convolutional neural networks Machine learning Melanoma Mitoses Pathology

Journal

Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society
ISSN: 1879-0771
Titre abrégé: Comput Med Imaging Graph
Pays: United States
ID NLM: 8806104

Informations de publication

Date de publication:
01 2021
Historique:
received: 01 01 2020
revised: 09 10 2020
accepted: 17 11 2020
pubmed: 11 12 2020
medline: 26 10 2021
entrez: 10 12 2020
Statut: ppublish

Résumé

Pathologists analyze biopsy material at both the cellular and structural level to determine diagnosis and cancer stage. Mitotic figures are surrogate biomarkers of cellular proliferation that can provide prognostic information; thus, their precise detection is an important factor for clinical care. Convolutional Neural Networks (CNNs) have shown remarkable performance on several recognition tasks. Utilizing CNNs for mitosis classification may aid pathologists to improve the detection accuracy. We studied two state-of-the-art CNN-based models, ESPNet and DenseNet, for mitosis classification on six whole slide images of skin biopsies and compared their quantitative performance in terms of sensitivity, specificity, and F-score. We used raw RGB images of mitosis and non-mitosis samples with their corresponding labels as training input. In order to compare with other work, we studied the performance of these classifiers and two other architectures, ResNet and ShuffleNet, on the publicly available MITOS breast biopsy dataset and compared the performance of all four in terms of precision, recall, and F-score (which are standard for this data set), architecture, training time and inference time. The ESPNet and DenseNet results on our primary melanoma dataset had a sensitivity of 0.976 and 0.968, and a specificity of 0.987 and 0.995, respectively, with F-scores of .968 and .976, respectively. On the MITOS dataset, ESPNet and DenseNet showed a sensitivity of 0.866 and 0.916, and a specificity of 0.973 and 0.980, respectively. The MITOS results using DenseNet had a precision of 0.939, recall of 0.916, and F-score of 0.927. The best published result on MITOS (Saha et al. 2018) reported precision of 0.92, recall of 0.88, and F-score of 0.90. In our architecture comparisons on MITOS, we found that DenseNet beats the others in terms of F-Score (DenseNet 0.927, ESPNet 0.890, ResNet 0.865, ShuffleNet 0.847) and especially Recall (DenseNet 0.916, ESPNet 0.866, ResNet 0.807, ShuffleNet 0.753), while ResNet and ESPNet have much faster inference times (ResNet 6 s, ESPNet 8 s, DenseNet 31 s). ResNet is faster than ESPNet, but ESPNet has a higher F-Score and Recall than ResNet, making it a good compromise solution. We studied several state-of-the-art CNNs for detecting mitotic figures in whole slide biopsy images. We evaluated two CNNs on a melanoma cancer dataset and then compared four CNNs on a public breast cancer data set, using the same methodology on both. Our methodology and architecture for mitosis finding in both melanoma and breast cancer whole slide images has been thoroughly tested and is likely to be useful for finding mitoses in any whole slide biopsy images.

Sections du résumé

BACKGROUND
Pathologists analyze biopsy material at both the cellular and structural level to determine diagnosis and cancer stage. Mitotic figures are surrogate biomarkers of cellular proliferation that can provide prognostic information; thus, their precise detection is an important factor for clinical care. Convolutional Neural Networks (CNNs) have shown remarkable performance on several recognition tasks. Utilizing CNNs for mitosis classification may aid pathologists to improve the detection accuracy.
METHODS
We studied two state-of-the-art CNN-based models, ESPNet and DenseNet, for mitosis classification on six whole slide images of skin biopsies and compared their quantitative performance in terms of sensitivity, specificity, and F-score. We used raw RGB images of mitosis and non-mitosis samples with their corresponding labels as training input. In order to compare with other work, we studied the performance of these classifiers and two other architectures, ResNet and ShuffleNet, on the publicly available MITOS breast biopsy dataset and compared the performance of all four in terms of precision, recall, and F-score (which are standard for this data set), architecture, training time and inference time.
RESULTS
The ESPNet and DenseNet results on our primary melanoma dataset had a sensitivity of 0.976 and 0.968, and a specificity of 0.987 and 0.995, respectively, with F-scores of .968 and .976, respectively. On the MITOS dataset, ESPNet and DenseNet showed a sensitivity of 0.866 and 0.916, and a specificity of 0.973 and 0.980, respectively. The MITOS results using DenseNet had a precision of 0.939, recall of 0.916, and F-score of 0.927. The best published result on MITOS (Saha et al. 2018) reported precision of 0.92, recall of 0.88, and F-score of 0.90. In our architecture comparisons on MITOS, we found that DenseNet beats the others in terms of F-Score (DenseNet 0.927, ESPNet 0.890, ResNet 0.865, ShuffleNet 0.847) and especially Recall (DenseNet 0.916, ESPNet 0.866, ResNet 0.807, ShuffleNet 0.753), while ResNet and ESPNet have much faster inference times (ResNet 6 s, ESPNet 8 s, DenseNet 31 s). ResNet is faster than ESPNet, but ESPNet has a higher F-Score and Recall than ResNet, making it a good compromise solution.
CONCLUSION
We studied several state-of-the-art CNNs for detecting mitotic figures in whole slide biopsy images. We evaluated two CNNs on a melanoma cancer dataset and then compared four CNNs on a public breast cancer data set, using the same methodology on both. Our methodology and architecture for mitosis finding in both melanoma and breast cancer whole slide images has been thoroughly tested and is likely to be useful for finding mitoses in any whole slide biopsy images.

Identifiants

pubmed: 33302246
pii: S0895-6111(20)30127-0
doi: 10.1016/j.compmedimag.2020.101832
pmc: PMC7855641
mid: NIHMS1653021
pii:
doi:

Types de publication

Journal Article Research Support, N.I.H., Extramural

Langues

eng

Sous-ensembles de citation

IM

Pagination

101832

Subventions

Organisme : NCI NIH HHS
ID : R01 CA200690
Pays : United States
Organisme : NCI NIH HHS
ID : U01 CA231782
Pays : United States

Commentaires et corrections

Type : ErratumIn

Informations de copyright

Copyright © 2020 Elsevier Ltd. All rights reserved.

Références

Med Image Anal. 2015 Feb;20(1):237-48
pubmed: 25547073
J Am Acad Dermatol. 2014 Jan;70(1):131-41
pubmed: 24176521
J Clin Oncol. 2011 Jun 1;29(16):2199-205
pubmed: 21519009
Med Image Comput Comput Assist Interv. 2013;16(Pt 2):411-8
pubmed: 24579167
Annu Int Conf IEEE Eng Med Biol Soc. 2009;2009:1433-6
pubmed: 19963746
Sci Rep. 2018 Mar 15;8(1):4165
pubmed: 29545529
Annu Int Conf IEEE Eng Med Biol Soc. 2013;2013:6091-4
pubmed: 24111129
JAMA. 2015 Mar 17;313(11):1122-32
pubmed: 25781441
Cell. 2018 Feb 22;172(5):1122-1131.e9
pubmed: 29474911
J Am Acad Dermatol. 2014 Dec;71(6):1204-11
pubmed: 25239732
J Pathol Inform. 2013 May 30;4:8
pubmed: 23858383
JAMA Netw Open. 2019 Aug 2;2(8):e198777
pubmed: 31397859
Comput Med Imaging Graph. 2018 Mar;64:29-40
pubmed: 29409716
Nature. 2017 Feb 2;542(7639):115-118
pubmed: 28117445
Cancer Res. 2017 Nov 1;77(21):e83-e86
pubmed: 29092947
Med Image Anal. 2018 Apr;45:121-133
pubmed: 29455111
BMJ. 2017 Jun 28;357:j2813
pubmed: 28659278

Auteurs

Shima Nofallah (S)

University of Washington, Seattle WA 98195, USA. Electronic address: shima@cs.washington.edu.

Sachin Mehta (S)

University of Washington, Seattle WA 98195, USA. Electronic address: sacmehta@cs.washington.edu.

Ezgi Mercan (E)

University of Washington, Seattle WA 98195, USA. Electronic address: ezgi@cs.washington.edu.

Stevan Knezevich (S)

Pathology Associates, Clovis, CA 983611, USA. Electronic address: shapiro@cs.washington.edu.

Caitlin J May (CJ)

University of Washington, Seattle WA 98195, USA. Electronic address: caitmay@u.washington.edu.

Donald Weaver (D)

University of Vermont, Burlington VT 05405, USA. Electronic address: donald.weaver@uvmhealth.org.

Daniela Witten (D)

University of Washington, Seattle WA 98195, USA. Electronic address: dwitten@uw.edu.

Joann G Elmore (JG)

David Geffen School of Medicine, UCLA, Los Angeles CA 90024, USA. Electronic address: jelmore@mednet.ucla.edu.

Linda Shapiro (L)

University of Washington, Seattle WA 98195, USA. Electronic address: shapiro@cs.washington.edu.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH