Tackling stain variability using CycleGAN-based stain augmentation.

Deep learning Digital pathology Kidney Segmentation Stain augmentation Stain normalization

Journal

Journal of pathology informatics
ISSN: 2229-5089
Titre abrégé: J Pathol Inform
Pays: United States
ID NLM: 101528849

Informations de publication

Date de publication:
2022
Historique:
received: 01 07 2022
revised: 04 09 2022
accepted: 07 09 2022
entrez: 21 10 2022
pubmed: 22 10 2022
medline: 22 10 2022
Statut: epublish

Résumé

Considerable inter- and intra-laboratory stain variability exists in pathology, representing a challenge in development and application of deep learning (DL) approaches. Since tackling all sources of stain variability with manual annotation is not feasible, we here investigated and compared unsupervised DL approaches to reduce the consequences of stain variability in kidney pathology. We aimed to improve the applicability of a pretrained DL segmentation model to 3 external multi-centric cohorts with large stain variability. In contrast to the traditional approach of training generative adversarial networks (GAN) for stain normalization, we here propose to tackle stain variability by data augmentation. We augment the training data of the pretrained model by the stain variability using CycleGANs and then retrain the model on the stain-augmented dataset. We compared the performance of i/ the unmodified pretrained segmentation model with ii/ CycleGAN-based stain normalization, iii/ a feature-preserving modification to ii/ for improved normalization, and iv/ the proposed stain-augmented model. The proposed stain-augmented model showed highest mean segmentation accuracy in all external cohorts and maintained comparable performance on the training cohort. However, the increase in performance was only marginal compared to the pretrained model. CycleGAN-based stain normalization suffered from encoded imperceptible information into the normalizations that confused the pretrained model and thus resulted in slightly worse performance. Our findings suggest that stain variability can be tackled more effectively by augmenting data by it than by following the commonly used approach of normalizing the stain. However, the applicability of this approach providing only a rather slight performance increase has to be weighted against an additional carbon footprint.

Sections du résumé

Background UNASSIGNED
Considerable inter- and intra-laboratory stain variability exists in pathology, representing a challenge in development and application of deep learning (DL) approaches. Since tackling all sources of stain variability with manual annotation is not feasible, we here investigated and compared unsupervised DL approaches to reduce the consequences of stain variability in kidney pathology.
Methods UNASSIGNED
We aimed to improve the applicability of a pretrained DL segmentation model to 3 external multi-centric cohorts with large stain variability. In contrast to the traditional approach of training generative adversarial networks (GAN) for stain normalization, we here propose to tackle stain variability by data augmentation. We augment the training data of the pretrained model by the stain variability using CycleGANs and then retrain the model on the stain-augmented dataset. We compared the performance of i/ the unmodified pretrained segmentation model with ii/ CycleGAN-based stain normalization, iii/ a feature-preserving modification to ii/ for improved normalization, and iv/ the proposed stain-augmented model.
Results UNASSIGNED
The proposed stain-augmented model showed highest mean segmentation accuracy in all external cohorts and maintained comparable performance on the training cohort. However, the increase in performance was only marginal compared to the pretrained model. CycleGAN-based stain normalization suffered from encoded imperceptible information into the normalizations that confused the pretrained model and thus resulted in slightly worse performance.
Conclusions UNASSIGNED
Our findings suggest that stain variability can be tackled more effectively by augmenting data by it than by following the commonly used approach of normalizing the stain. However, the applicability of this approach providing only a rather slight performance increase has to be weighted against an additional carbon footprint.

Identifiants

pubmed: 36268102
doi: 10.1016/j.jpi.2022.100140
pii: S2153-3539(22)00734-9
pmc: PMC9577138
doi:

Types de publication

Journal Article

Langues

eng

Pagination

100140

Informations de copyright

© 2022 The Authors.

Déclaration de conflit d'intérêts

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.     

Références

J Am Soc Nephrol. 2021 Jan;32(1):52-68
pubmed: 33154175
IEEE Rev Biomed Eng. 2009;2:147-71
pubmed: 20671804
Med Image Anal. 2019 Dec;58:101544
pubmed: 31466046
IEEE Trans Med Imaging. 2019 Oct;38(10):2293-2302
pubmed: 30762541
Nature. 2019 Oct;574(7777):187-192
pubmed: 31597973
Kidney Int. 2021 Mar;99(3):498-510
pubmed: 33637194
Kidney Int. 2014 Oct;86(4):828-36
pubmed: 24694989
Patterns (N Y). 2020 Sep 11;1(6):100089
pubmed: 33205132
Nat Biomed Eng. 2019 Jun;3(6):466-477
pubmed: 31142829
IEEE Trans Med Imaging. 2016 Feb;35(2):404-15
pubmed: 26353368
Sci Rep. 2017 Dec 4;7(1):16878
pubmed: 29203879
IEEE Trans Med Imaging. 2016 Aug;35(8):1962-71
pubmed: 27164577
Nat Methods. 2021 Feb;18(2):203-211
pubmed: 33288961
Sci Rep. 2020 Oct 15;10(1):17507
pubmed: 33060677
Knowl Inf Syst. 2013 Sep 1;36(3):537-556
pubmed: 24039326

Auteurs

Nassim Bouteldja (N)

Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany.

David L Hölscher (DL)

Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany.

Roman D Bülow (RD)

Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany.

Ian S D Roberts (ISD)

Department of Cellular Pathology, Oxford University Hospitals National Health Service Foundation Trust, Oxford, United Kingdom.

Rosanna Coppo (R)

Fondazione Ricerca Molinette, Torino, Italy.
Regina Margherita Children's University Hospital, Torino, Italy.

Peter Boor (P)

Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany.
Department of Nephrology and Immunology, RWTH Aachen University Hospital, Aachen, Germany.

Classifications MeSH