Automated eloquent cortex localization in brain tumor patients using multi-task graph neural networks.
Convolutional neural networks
Eloquent cortex localization
Multi-task learning
Resting-state fMRI
Journal
Medical image analysis
ISSN: 1361-8423
Titre abrégé: Med Image Anal
Pays: Netherlands
ID NLM: 9713490
Informations de publication
Date de publication:
12 2021
12 2021
Historique:
received:
12
06
2020
revised:
04
06
2021
accepted:
08
06
2021
pubmed:
3
9
2021
medline:
1
2
2022
entrez:
2
9
2021
Statut:
ppublish
Résumé
Localizing the eloquent cortex is a crucial part of presurgical planning. While invasive mapping is the gold standard, there is increasing interest in using noninvasive fMRI to shorten and improve the process. However, many surgical patients cannot adequately perform task-based fMRI protocols. Resting-state fMRI has emerged as an alternative modality, but automated eloquent cortex localization remains an open challenge. In this paper, we develop a novel deep learning architecture to simultaneously identify language and primary motor cortex from rs-fMRI connectivity. Our approach uses the representational power of convolutional neural networks alongside the generalization power of multi-task learning to find a shared representation between the eloquent subnetworks. We validate our method on data from the publicly available Human Connectome Project and on a brain tumor dataset acquired at the Johns Hopkins Hospital. We compare our method against feature-based machine learning approaches and a fully-connected deep learning model that does not account for the shared network organization of the data. Our model achieves significantly better performance than competing baselines. We also assess the generalizability and robustness of our method. Our results clearly demonstrate the advantages of our graph convolution architecture combined with multi-task learning and highlight the promise of using rs-fMRI as a presurgical mapping tool.
Identifiants
pubmed: 34474216
pii: S1361-8415(21)00248-6
doi: 10.1016/j.media.2021.102203
pmc: PMC9245684
mid: NIHMS1807495
pii:
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Pagination
102203Subventions
Organisme : NCI NIH HHS
ID : R21 CA263804
Pays : United States
Informations de copyright
Copyright © 2021. Published by Elsevier B.V.
Déclaration de conflit d'intérêts
Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Références
Epilepsy Behav. 2011 Nov;22(3):527-31
pubmed: 21937281
AJNR Am J Neuroradiol. 2012 Dec;33(11):2151-7
pubmed: 22595902
Neuroimage. 2013 Oct 15;80:397-404
pubmed: 23558097
Brain Lang. 1978 Sep;6(2):239-60
pubmed: 728789
Radiology. 2006 Sep;240(3):793-802
pubmed: 16857981
Neuroimage. 2007 Aug 1;37(1):90-101
pubmed: 17560126
Front Neurosci. 2014 Jul 01;8:167
pubmed: 25071425
Magn Reson Imaging. 2009 Jul;27(6):733-40
pubmed: 19110394
Psychiatry Res Neuroimaging. 2016 Mar 30;249:12-9
pubmed: 27000302
Neuroimage. 2014 Dec;103:462-475
pubmed: 25172207
AJNR Am J Neuroradiol. 2013 Oct;34(10):1866-72
pubmed: 22936095
Neuroimage. 2011 Jan 15;54(2):1465-75
pubmed: 20884358
Radiology. 2008 Aug;248(2):579-89
pubmed: 18539893
Neuroimage. 2004 Jan;21(1):422-35
pubmed: 14741679
Neurosurg Clin N Am. 2011 Apr;22(2):111-32, vii
pubmed: 21435565
J Comput Assist Tomogr. 2000 Nov-Dec;24(6):927-34
pubmed: 11105714
Neuroimage. 2015 Apr 1;109:298-306
pubmed: 25613438
Med Image Anal. 2018 Jan;43:98-111
pubmed: 29040911
PLoS One. 2018 Jun 22;13(6):e0198349
pubmed: 29933375
Sci Rep. 2016 Jun 01;6:26972
pubmed: 27248706
Neuroimage. 2013 Oct 15;80:62-79
pubmed: 23684880
Neurosurgery. 1989 Nov;25(5):786-92
pubmed: 2586730
Neuroimage. 2017 Feb 1;146:1038-1049
pubmed: 27693612
Neuroimage. 2012 Aug 15;62(2):782-90
pubmed: 21979382
Hum Brain Mapp. 2014 Mar;35(3):1018-30
pubmed: 23288627
IEEE Winter Conf Appl Comput Vis. 2021 Jan;2021:2512-2522
pubmed: 34522832
Neuroradiol J. 2017 Aug;30(4):305-317
pubmed: 28353416
J Neurophysiol. 2011 Nov;106(5):2322-45
pubmed: 21795627
Magn Reson Med. 1995 Oct;34(4):537-41
pubmed: 8524021
Lancet Neurol. 2005 Aug;4(8):476-86
pubmed: 16033690
Neurology. 1996 Apr;46(4):978-84
pubmed: 8780076
Med Image Anal. 2017 Jan;35:18-31
pubmed: 27310171
Epilepsy Behav. 2009 Oct;16(2):288-97
pubmed: 19733509
Hum Brain Mapp. 2012 Aug;33(8):1914-28
pubmed: 21769991
Clin Neurol Neurosurg. 2007 May;109(4):335-43
pubmed: 17303322
Neurology. 2003 Jun 10;60(11):1788-92
pubmed: 12796532
J Neurosurg. 2003 Apr;98(4):764-78
pubmed: 12691401
Neuroimage. 2013 Nov 15;82:616-633
pubmed: 23735260
Neurosci Biobehav Rev. 2018 Jan;84:245-261
pubmed: 29198588
Acad Radiol. 2009 May;16(5):578-83
pubmed: 19345899
Nat Neurosci. 2015 Nov;18(11):1664-71
pubmed: 26457551
Neurosurgery. 2010 Jan;66(1):113-20
pubmed: 19935438
Neuroimaging Clin N Am. 2014 Nov;24(4):557-71
pubmed: 25441500
Schizophr Res. 2012 Aug;139(1-3):7-12
pubmed: 22633528
Hum Brain Mapp. 2018 Oct;39(10):4032-4042
pubmed: 29962111
Hum Brain Mapp. 2016 Mar;37(3):913-23
pubmed: 26663615
Ann Neurol. 2011 Mar;69(3):521-32
pubmed: 21400562
Nat Commun. 2020 Nov 26;11(1):6010
pubmed: 33243992
Ann Neurol. 2001 Nov;50(5):620-9
pubmed: 11706968
Nat Rev Neurosci. 2007 Sep;8(9):700-11
pubmed: 17704812
AJNR Am J Neuroradiol. 2018 Aug;39(8):1493-1498
pubmed: 30002054
Top Magn Reson Imaging. 2016 Feb;25(1):11-8
pubmed: 26848556
Mol Psychiatry. 2012 Jul;17(8):759
pubmed: 22824848
Adv Neural Inf Process Syst. 2010;1:1225-1233
pubmed: 24808719
Neurosurgery. 1998 May;42(5):1044-55; discussion 1055-6
pubmed: 9588549
Neuroimage. 2011 Jan;54 Suppl 1:S136-45
pubmed: 20380883
Cereb Cortex. 2014 Mar;24(3):663-76
pubmed: 23146964
PLoS One. 2014 Jun 10;9(6):e98860
pubmed: 24914775
Neurology. 1988 Sep;38(9):1374-9
pubmed: 3412585
Radiology. 1994 Jan;190(1):85-92
pubmed: 8259434