DeepAI AI Chat
Log In Sign Up

Distribution Matching Losses Can Hallucinate Features in Medical Image Translation

05/22/2018
by   Joseph Paul Cohen, et al.
Université de Montréal
0

This paper discusses how distribution matching losses, such as those used in CycleGAN, when used to synthesize medical images can lead to mis-diagnosis of medical conditions. It seems appealing to use these new image synthesis methods for translating images from a source to a target domain because they can produce high quality images and some even do not require paired data. However, the basis of how these image translation models work is through matching the translation output to the distribution of the target domain. This can cause an issue when the data provided in the target domain has an over or under representation of some classes (e.g. healthy or sick). When the output of an algorithm is a transformed image there are uncertainties whether all known and unknown class labels have been preserved or changed. Therefore, we recommend that these translated images should not be used for direct interpretation (e.g. by doctors) because they may lead to misdiagnosis of patients based on hallucinated image features by an algorithm that matches a distribution. However there are many recent papers that seem as though this is the goal.

READ FULL TEXT

page 2

page 6

page 7

page 9

page 10

page 11

04/05/2023

Zero-shot Medical Image Translation via Frequency-Guided Diffusion Models

Recently, the diffusion model has emerged as a superior generative model...
11/27/2020

Manipulating Medical Image Translation with Manifold Disentanglement

Medical image translation (e.g. CT to MR) is a challenging task as it re...
03/08/2019

Unsupervised Medical Image Translation Using Cycle-MedGAN

Image-to-image translation is a new field in computer vision with multip...
01/26/2020

Visualisation of Medical Image Fusion and Translation for Accurate Diagnosis of High Grade Gliomas

The medical image fusion combines two or more modalities into a single v...
11/29/2018

Image Translation to Mixed-Domain using Sym-Parameterized Generative Network

Recent advances in image-to-image translation have led to some ways to g...
12/03/2021

Image-to-image Translation as a Unique Source of Knowledge

Image-to-image (I2I) translation is an established way of translating da...
10/31/2020

Pose Randomization for Weakly Paired Image Style Translation

Utilizing the trained model under different conditions without data anno...