Coordinate Translator for Learning Deformable Medical Image Registration.
Deep learning
Deformable image registration
Magnetic resonance imaging
Template matching
Journal
Multiscale multimodal medical imaging : Third International Workshop, MMMI 2022, held in conjunction with MICCAI 2022, Singapore, September 22, 2022, proceedings
Titre abrégé: Multiscale Multimodal Med Imaging (2022)
Pays: Switzerland
ID NLM: 9918487375006676
Informations de publication
Date de publication:
Sep 2022
Sep 2022
Historique:
entrez:
30
1
2023
pubmed:
31
1
2023
medline:
31
1
2023
Statut:
ppublish
Résumé
The majority of deep learning (DL) based deformable image registration methods use convolutional neural networks (CNNs) to estimate displacement fields from pairs of moving and fixed images. This, however, requires the convolutional kernels in the CNN to not only extract intensity features from the inputs but also understand image coordinate systems. We argue that the latter task is challenging for traditional CNNs, limiting their performance in registration tasks. To tackle this problem, we first introduce Coordinate Translator, a differentiable module that identifies matched features between the fixed and moving image and outputs their coordinate correspondences without the need for training. It unloads the burden of understanding image coordinate systems for CNNs, allowing them to focus on feature extraction. We then propose a novel deformable registration network, im2grid, that uses multiple Coordinate Translator's with the hierarchical features extracted from a CNN encoder and outputs a deformation field in a coarse-to-fine fashion. We compared im2grid with the state-of-the-art DL and non-DL methods for unsupervised 3D magnetic resonance image registration. Our experiments show that im2grid outperforms these methods both qualitatively and quantitatively.
Identifiants
pubmed: 36716114
doi: 10.1007/978-3-031-18814-5_10
pmc: PMC9878358
mid: NIHMS1864533
doi:
Types de publication
Journal Article
Langues
eng
Pagination
98-109Subventions
Organisme : NEI NIH HHS
ID : R01 EY032284
Pays : United States
Références
IEEE Trans Med Imaging. 2010 Jan;29(1):196-205
pubmed: 19923044
IEEE Trans Med Imaging. 2022 Oct;41(10):2788-2802
pubmed: 35482699
Med Image Comput Comput Assist Interv. 2017 Sep;10433:300-308
pubmed: 29250613
Comput Vis Image Underst. 1997 May;66(2):207-22
pubmed: 11543561
IEEE Trans Med Imaging. 2007 Apr;26(4):487-96
pubmed: 17427736
Proc SPIE Int Soc Opt Eng. 2019 Mar;10949:
pubmed: 31551645
Med Image Anal. 2019 May;54:193-206
pubmed: 30939419
Comput Vis Image Underst. 2013 Sep 1;117(9):1095-1106
pubmed: 24058278
Neuroimage. 2019 Jul 1;194:105-119
pubmed: 30910724
IEEE Trans Med Imaging. 2010 Jun;29(6):1310-20
pubmed: 20378467
Neuroimage. 2009 Mar;45(1 Suppl):S61-72
pubmed: 19041946
Med Image Anal. 2008 Feb;12(1):26-41
pubmed: 17659998
IEEE Trans Med Imaging. 2019 Feb 04;:
pubmed: 30716034
Med Image Anal. 2019 Feb;52:128-143
pubmed: 30579222
IEEE Trans Med Imaging. 1999 Aug;18(8):712-21
pubmed: 10534053
IEEE Trans Med Imaging. 2022 Oct 20;PP:
pubmed: 36264729
Med Image Anal. 1998 Sep;2(3):243-60
pubmed: 9873902
Neuroimage. 2017 Sep;158:378-396
pubmed: 28705497
Neuroimage. 2012 Aug 15;62(2):774-81
pubmed: 22248573