Attribute Regularized Soft Introspective VAE: Towards Cardiac Attribute Regularization Through MRI Domains

07/24/2023
by   Maxime Di Folco, et al.
0

Deep generative models have emerged as influential instruments for data generation and manipulation. Enhancing the controllability of these models by selectively modifying data attributes has been a recent focus. Variational Autoencoders (VAEs) have shown promise in capturing hidden attributes but often produce blurry reconstructions. Controlling these attributes through different imaging domains is difficult in medical imaging. Recently, Soft Introspective VAE leverage the benefits of both VAEs and Generative Adversarial Networks (GANs), which have demonstrated impressive image synthesis capabilities, by incorporating an adversarial loss into VAE training. In this work, we propose the Attributed Soft Introspective VAE (Attri-SIVAE) by incorporating an attribute regularized loss, into the Soft-Intro VAE framework. We evaluate experimentally the proposed method on cardiac MRI data from different domains, such as various scanner vendors and acquisition centers. The proposed method achieves similar performance in terms of reconstruction and regularization compared to the state-of-the-art Attributed regularized VAE but additionally also succeeds in keeping the same regularization level when tested on a different dataset, unlike the compared method.

READ FULL TEXT

page 6

page 8

page 12

research
03/20/2022

Attri-VAE: attribute-based, disentangled and interpretable representations of medical images with variational autoencoders

Deep learning (DL) methods where interpretability is intrinsically consi...
research
04/11/2020

Attribute-based Regularization of VAE Latent Spaces

Selective manipulation of data attributes using deep generative models i...
research
08/25/2019

Recon-GLGAN: A Global-Local context based Generative Adversarial Network for MRI Reconstruction

Magnetic resonance imaging (MRI) is one of the best medical imaging moda...
research
11/14/2017

Conditional Autoencoders with Adversarial Information Factorization

Generative models, such as variational auto-encoders (VAE) and generativ...
research
02/03/2019

Adversarial Networks and Autoencoders: The Primal-Dual Relationship and Generalization Bounds

Since the introduction of Generative Adversarial Networks (GANs) and Var...
research
07/20/2020

Incorporating Reinforced Adversarial Learning in Autoregressive Image Generation

Autoregressive models recently achieved comparable results versus state-...
research
09/09/2020

Multilinear Latent Conditioning for Generating Unseen Attribute Combinations

Deep generative models rely on their inductive bias to facilitate genera...

Please sign up or login with your details

Forgot password? Click here to reset