Coordinate Translator for Learning Deformable Medical Image Registration.

Deep learning Deformable image registration Magnetic resonance imaging Template matching

Journal

Multiscale multimodal medical imaging : Third International Workshop, MMMI 2022, held in conjunction with MICCAI 2022, Singapore, September 22, 2022, proceedings
Titre abrégé: Multiscale Multimodal Med Imaging (2022)
Pays: Switzerland
ID NLM: 9918487375006676

Informations de publication

Date de publication:
Sep 2022
Historique:
entrez: 30 1 2023
pubmed: 31 1 2023
medline: 31 1 2023
Statut: ppublish

Résumé

The majority of deep learning (DL) based deformable image registration methods use convolutional neural networks (CNNs) to estimate displacement fields from pairs of moving and fixed images. This, however, requires the convolutional kernels in the CNN to not only extract intensity features from the inputs but also understand image coordinate systems. We argue that the latter task is challenging for traditional CNNs, limiting their performance in registration tasks. To tackle this problem, we first introduce Coordinate Translator, a differentiable module that identifies matched features between the fixed and moving image and outputs their coordinate correspondences without the need for training. It unloads the burden of understanding image coordinate systems for CNNs, allowing them to focus on feature extraction. We then propose a novel deformable registration network, im2grid, that uses multiple Coordinate Translator's with the hierarchical features extracted from a CNN encoder and outputs a deformation field in a coarse-to-fine fashion. We compared im2grid with the state-of-the-art DL and non-DL methods for unsupervised 3D magnetic resonance image registration. Our experiments show that im2grid outperforms these methods both qualitatively and quantitatively.

Identifiants

pubmed: 36716114
doi: 10.1007/978-3-031-18814-5_10
pmc: PMC9878358
mid: NIHMS1864533
doi:

Types de publication

Journal Article

Langues

eng

Pagination

98-109

Subventions

Organisme : NEI NIH HHS
ID : R01 EY032284
Pays : United States

Références

IEEE Trans Med Imaging. 2010 Jan;29(1):196-205
pubmed: 19923044
IEEE Trans Med Imaging. 2022 Oct;41(10):2788-2802
pubmed: 35482699
Med Image Comput Comput Assist Interv. 2017 Sep;10433:300-308
pubmed: 29250613
Comput Vis Image Underst. 1997 May;66(2):207-22
pubmed: 11543561
IEEE Trans Med Imaging. 2007 Apr;26(4):487-96
pubmed: 17427736
Proc SPIE Int Soc Opt Eng. 2019 Mar;10949:
pubmed: 31551645
Med Image Anal. 2019 May;54:193-206
pubmed: 30939419
Comput Vis Image Underst. 2013 Sep 1;117(9):1095-1106
pubmed: 24058278
Neuroimage. 2019 Jul 1;194:105-119
pubmed: 30910724
IEEE Trans Med Imaging. 2010 Jun;29(6):1310-20
pubmed: 20378467
Neuroimage. 2009 Mar;45(1 Suppl):S61-72
pubmed: 19041946
Med Image Anal. 2008 Feb;12(1):26-41
pubmed: 17659998
IEEE Trans Med Imaging. 2019 Feb 04;:
pubmed: 30716034
Med Image Anal. 2019 Feb;52:128-143
pubmed: 30579222
IEEE Trans Med Imaging. 1999 Aug;18(8):712-21
pubmed: 10534053
IEEE Trans Med Imaging. 2022 Oct 20;PP:
pubmed: 36264729
Med Image Anal. 1998 Sep;2(3):243-60
pubmed: 9873902
Neuroimage. 2017 Sep;158:378-396
pubmed: 28705497
Neuroimage. 2012 Aug 15;62(2):774-81
pubmed: 22248573

Auteurs

Yihao Liu (Y)

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.

Lianrui Zuo (L)

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.
Laboratory of Behavioral Neuroscience, National Institute on Aging, National Institute of Health, Baltimore, MD 20892, USA.

Shuo Han (S)

Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.

Yuan Xue (Y)

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.

Jerry L Prince (JL)

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.

Aaron Carass (A)

Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.

Classifications MeSH