Unsupervised Image-to-Image Translation: A Review.

computer vision deep learning generative adversarial networks machine learning review unsupervised image-to-image translation

Journal

Sensors (Basel, Switzerland)
ISSN: 1424-8220
Titre abrégé: Sensors (Basel)
Pays: Switzerland
ID NLM: 101204366

Informations de publication

Date de publication:
06 Nov 2022
Historique:
received: 07 10 2022
revised: 27 10 2022
accepted: 28 10 2022
entrez: 11 11 2022
pubmed: 12 11 2022
medline: 15 11 2022
Statut: epublish

Résumé

Supervised image-to-image translation has been proven to generate realistic images with sharp details and to have good quantitative performance. Such methods are trained on a paired dataset, where an image from the source domain already has a corresponding translated image in the target domain. However, this paired dataset requirement imposes a huge practical constraint, requires domain knowledge or is even impossible to obtain in certain cases. Due to these problems, unsupervised image-to-image translation has been proposed, which does not require domain expertise and can take advantage of a large unlabeled dataset. Although such models perform well, they are hard to train due to the major constraints induced in their loss functions, which make training unstable. Since CycleGAN has been released, numerous methods have been proposed which try to address various problems from different perspectives. In this review, we firstly describe the general image-to-image translation framework and discuss the datasets and metrics involved in the topic. Furthermore, we revise the current state-of-the-art with a classification of existing works. This part is followed by a small quantitative evaluation, for which results were taken from papers.

Identifiants

pubmed: 36366238
pii: s22218540
doi: 10.3390/s22218540
pmc: PMC9654990
pii:
doi:

Types de publication

Journal Article Review

Langues

eng

Sous-ensembles de citation

IM

Subventions

Organisme : Fonds National de la Recherche
ID : 15411817

Références

IEEE Trans Image Process. 2012 Apr;21(4):1500-12
pubmed: 22106145
IEEE Trans Neural Netw Learn Syst. 2021 Sep 02;PP:
pubmed: 34473628
IEEE Trans Pattern Anal Mach Intell. 2021 Dec;43(12):4217-4228
pubmed: 32012000
Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2019 Jun;2019:2422-2431
pubmed: 32076365
IEEE Trans Pattern Anal Mach Intell. 2018 Jun;40(6):1452-1464
pubmed: 28692961
IEEE Trans Pattern Anal Mach Intell. 2006 Apr;28(4):594-611
pubmed: 16566508

Auteurs

Henri Hoyez (H)

Paul Wurth S.A., 1122 Luxembourg, Luxembourg.
Department Computer Science, Technische Universität Kaiserslautern, 67663 Kaiserslautern, Germany.

Cédric Schockaert (C)

Paul Wurth S.A., 1122 Luxembourg, Luxembourg.

Jason Rambach (J)

German Research Center for Artificial Intelligence (DFKI), 67663 Kaiserslautern, Germany.

Bruno Mirbach (B)

German Research Center for Artificial Intelligence (DFKI), 67663 Kaiserslautern, Germany.

Didier Stricker (D)

Paul Wurth S.A., 1122 Luxembourg, Luxembourg.
Department Computer Science, Technische Universität Kaiserslautern, 67663 Kaiserslautern, Germany.

Articles similaires

1.00
Humans Magnetic Resonance Imaging Brain Infant, Newborn Infant, Premature
Cephalometry Humans Anatomic Landmarks Software Internet
Humans Artificial Intelligence Neoplasms Prognosis Image Processing, Computer-Assisted
Humans Breast Neoplasms Female Deep Learning Ultrasonography, Mammary

Classifications MeSH