Image Morphing in Deep Feature Spaces: Theory and Applications.

Convolutional neural networks Image morphing Metamorphosis model Mosco convergence Variational time discretization

Journal

Journal of mathematical imaging and vision
ISSN: 0924-9907
Titre abrégé: J Math Imaging Vis
Pays: Netherlands
ID NLM: 101512096

Informations de publication

Date de publication:
2021
Historique:
received: 23 10 2019
accepted: 08 06 2020
entrez: 25 2 2021
pubmed: 26 2 2021
medline: 26 2 2021
Statut: ppublish

Résumé

This paper combines image metamorphosis with deep features. To this end, images are considered as maps into a high-dimensional feature space and a structure-sensitive, anisotropic flow regularization is incorporated in the metamorphosis model proposed by Miller and Younes (Int J Comput Vis 41(1):61-84, 2001) and Trouvé and Younes (Found Comput Math 5(2):173-198, 2005). For this model, a variational time discretization of the Riemannian path energy is presented and the existence of discrete geodesic paths minimizing this energy is demonstrated. Furthermore, convergence of discrete geodesic paths to geodesic paths in the time continuous model is investigated. The spatial discretization is based on a finite difference approximation in image space and a stable spline approximation in deformation space; the fully discrete model is optimized using the iPALM algorithm. Numerical experiments indicate that the incorporation of semantic deep features is superior to intensity-based approaches.

Identifiants

pubmed: 33627956
doi: 10.1007/s10851-020-00974-5
pii: 974
pmc: PMC7878289
doi:

Types de publication

Journal Article

Langues

eng

Pagination

309-327

Informations de copyright

© The Author(s) 2020.

Références

Annu Rev Biomed Eng. 2002;4:375-405
pubmed: 12117763
IEEE Trans Image Process. 2000;9(8):1357-70
pubmed: 18262973
Annu Rev Biomed Eng. 2015;17:447-509
pubmed: 26643025

Auteurs

Alexander Effland (A)

Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria.

Erich Kobler (E)

Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria.

Thomas Pock (T)

Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria.

Marko Rajković (M)

Institute of Numerical Simulation, University of Bonn, Bonn, Germany.

Martin Rumpf (M)

Institute of Numerical Simulation, University of Bonn, Bonn, Germany.

Classifications MeSH