Unpaired Image-to-Image Translation via Neural Schrödinger Bridge

05/24/2023
by   Beomsu Kim, et al.
0

Diffusion models are a powerful class of generative models which simulate stochastic differential equations (SDEs) to generate data from noise. Although diffusion models have achieved remarkable progress in recent years, they have limitations in the unpaired image-to-image translation tasks due to the Gaussian prior assumption. Schrödinger Bridge (SB), which learns an SDE to translate between two arbitrary distributions, have risen as an attractive solution to this problem. However, none of SB models so far have been successful at unpaired translation between high-resolution images. In this work, we propose the Unpaired Neural Schrödinger Bridge (UNSB), which combines SB with adversarial training and regularization to learn a SB between unpaired data. We demonstrate that UNSB is scalable, and that it successfully solves various unpaired image-to-image translation tasks. Code: <https://github.com/cyclomon/UNSB>

READ FULL TEXT

page 2

page 7

page 9

page 13

page 14

page 15

research
05/16/2022

VQBB: Image-to-image Translation with Vector Quantized Brownian Bridge

Image-to-image translation is an important and challenging problem in co...
research
11/16/2022

Squeeze flow of micro-droplets: convolutional neural network with trainable and tunable refinement

We propose a platform based on neural networks to solve the image-to-ima...
research
07/14/2022

EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations

Score-based diffusion generative models (SDGMs) have achieved the SOTA F...
research
08/26/2023

DiffI2I: Efficient Diffusion Model for Image-to-Image Translation

The Diffusion Model (DM) has emerged as the SOTA approach for image synt...
research
07/02/2023

Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification

Prostate Cancer (PCa) is often diagnosed using High-resolution 3.0 Tesla...
research
05/04/2022

Hypercomplex Image-to-Image Translation

Image-to-image translation (I2I) aims at transferring the content repres...
research
02/12/2023

I^2SB: Image-to-Image Schrödinger Bridge

We propose Image-to-Image Schrödinger Bridge (I^2SB), a new class of con...

Please sign up or login with your details

Forgot password? Click here to reset