Transductive Transfer Learning for Domain Adaptation in Brain Magnetic Resonance Image Segmentation.

brain deep learning domain adaptation magnetic resonance imaging segmentation sub-cortical structures transductive learning white matter hyperintensities

Journal

Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481

Informations de publication

Date de publication:
2021
Historique:
received: 21 09 2020
accepted: 26 03 2021
entrez: 17 5 2021
pubmed: 18 5 2021
medline: 18 5 2021
Statut: epublish

Résumé

Segmentation of brain images from Magnetic Resonance Images (MRI) is an indispensable step in clinical practice. Morphological changes of sub-cortical brain structures and quantification of brain lesions are considered biomarkers of neurological and neurodegenerative disorders and used for diagnosis, treatment planning, and monitoring disease progression. In recent years, deep learning methods showed an outstanding performance in medical image segmentation. However, these methods suffer from generalisability problem due to inter-centre and inter-scanner variabilities of the MRI images. The main objective of the study is to develop an automated deep learning segmentation approach that is accurate and robust to the variabilities in scanner and acquisition protocols. In this paper, we propose a transductive transfer learning approach for domain adaptation to reduce the domain-shift effect in brain MRI segmentation. The transductive scenario assumes that there are sets of images from two different domains: (1) source-images with manually annotated labels; and (2) target-images without expert annotations. Then, the network is jointly optimised integrating both source and target images into the transductive training process to segment the regions of interest and to minimise the domain-shift effect. We proposed to use a histogram loss in the feature level to carry out the latter optimisation problem. In order to demonstrate the benefit of the proposed approach, the method has been tested in two different brain MRI image segmentation problems using multi-centre and multi-scanner databases for: (1) sub-cortical brain structure segmentation; and (2) white matter hyperintensities segmentation. The experiments showed that the segmentation performance of a pre-trained model could be significantly improved by up to 10%. For the first segmentation problem it was possible to achieve a maximum improvement from 0.680 to 0.799 in average Dice Similarity Coefficient (DSC) metric and for the second problem the average DSC improved from 0.504 to 0.602. Moreover, the improvements after domain adaptation were on par or showed better performance compared to the commonly used traditional unsupervised segmentation methods (FIRST and LST), also achieving faster execution time. Taking this into account, this work presents one more step toward the practical implementation of deep learning algorithms into the clinical routine.

Identifiants

pubmed: 33994917
doi: 10.3389/fnins.2021.608808
pmc: PMC8116893
doi:

Types de publication

Journal Article

Langues

eng

Pagination

608808

Informations de copyright

Copyright © 2021 Kushibar, Salem, Valverde, Rovira, Salvi, Oliver and Lladó.

Déclaration de conflit d'intérêts

ÀR serves on scientific advisory boards for Novartis, Sanofi-Genzyme, Icometrix, SyntheticMR, and OLEA Medical, and has received speaker honoraria from Bayer, Sanofi-Genzyme, Bracco, Merck-Serono, Teva Pharmaceutical Industries Ltd, Novartis, Roche, and Biogen Idec. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Références

Neuroimage Clin. 2019;21:101638
pubmed: 30555005
BMC Neurol. 2011 Feb 28;11:29
pubmed: 21356112
J Cogn Neurosci. 1996 Nov;8(6):566-87
pubmed: 23961985
Neuroinformatics. 2012 Jul;10(3):319-22
pubmed: 22006352
Neuroimage. 2011 Jun 1;56(3):907-22
pubmed: 21352927
Neuroimage. 2017 Jul 15;155:159-168
pubmed: 28435096
Am J Psychiatry. 2005 Jul;162(7):1256-65
pubmed: 15994707
Sci Rep. 2019 May 1;9(1):6742
pubmed: 31043688
Comput Methods Programs Biomed. 2010 Jun;98(3):278-84
pubmed: 19818524
Brain. 2008 Dec;131(Pt 12):3277-85
pubmed: 19022861
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
IEEE Trans Med Imaging. 2020 Jul;39(7):2494-2505
pubmed: 32054572
Med Image Anal. 2011 Apr;15(2):267-82
pubmed: 21233004
Med Image Anal. 2019 Dec;58:101552
pubmed: 31521965
AJNR Am J Neuroradiol. 2014 Dec;35(12):2257-64
pubmed: 25082821
Front Comput Neurosci. 2020 Mar 09;14:19
pubmed: 32210780
Ann Neurol. 2011 Feb;69(2):292-302
pubmed: 21387374
IEEE Trans Med Imaging. 2011 Sep;30(9):1617-34
pubmed: 21880566
Artif Intell Med. 2016 Oct;73:45-69
pubmed: 27926381
Neuroimage. 2018 Apr 15;170:434-445
pubmed: 28223187
Lancet Neurol. 2016 Mar;15(3):292-303
pubmed: 26822746
IEEE Trans Pattern Anal Mach Intell. 2019 Apr;41(4):801-814
pubmed: 29994060
IEEE Trans Med Imaging. 2019 Nov;38(11):2556-2568
pubmed: 30908194
Neuroimage Clin. 2019;23:101849
pubmed: 31085465
Radiology. 2018 Aug;288(2):554-564
pubmed: 29714673
J Digit Imaging. 2017 Aug;30(4):449-459
pubmed: 28577131
IEEE Trans Med Imaging. 2000 Feb;19(2):143-50
pubmed: 10784285
Brain. 2005 Nov;128(Pt 11):2705-12
pubmed: 16230320
Med Image Anal. 2013 Jan;17(1):1-18
pubmed: 23084503
IEEE Trans Med Imaging. 2012 Feb;31(2):153-63
pubmed: 21827972
BMJ. 2010 Jul 26;341:c3666
pubmed: 20660506
Neurology. 2007 Sep 18;69(12):1213-23
pubmed: 17875909
IEEE Trans Med Imaging. 2021 May;40(5):1363-1376
pubmed: 33507867
Neuroimage. 2016 May 15;132:198-212
pubmed: 26923370
IEEE Trans Med Imaging. 2020 Sep;39(9):2806-2817
pubmed: 32091996
Artif Intell Med. 2019 Apr;95:64-81
pubmed: 30195984
Neuroimage. 2018 Apr 15;170:456-470
pubmed: 28450139
Biol Psychiatry. 2010 Jul 1;68(1):41-50
pubmed: 20609836
Med Image Anal. 2018 Aug;48:177-186
pubmed: 29935442

Auteurs

Kaisar Kushibar (K)

Institute of Computer Vision and Robotics, University of Girona, Girona, Spain.

Mostafa Salem (M)

Institute of Computer Vision and Robotics, University of Girona, Girona, Spain.
Computer Science Department, Faculty of Computers and Information, Assiut University, Asyut, Egypt.

Sergi Valverde (S)

Institute of Computer Vision and Robotics, University of Girona, Girona, Spain.

Àlex Rovira (À)

Magnetic Resonance Unit, Department of Radiology, Vall d'Hebron University Hospital, Barcelona, Spain.

Joaquim Salvi (J)

Institute of Computer Vision and Robotics, University of Girona, Girona, Spain.

Arnau Oliver (A)

Institute of Computer Vision and Robotics, University of Girona, Girona, Spain.

Xavier Lladó (X)

Institute of Computer Vision and Robotics, University of Girona, Girona, Spain.

Classifications MeSH