Exploring constraints on CycleGAN-based CBCT enhancement for adaptive radiotherapy

10/09/2021
by   Suraj Pai, et al.
6

Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community, as it is able to leverage unpaired datasets effectively. However, clinical acceptance of these synthetic images pose a significant challenge as they are subject to strict evaluation protocols. A commonly established drawback of the CycleGAN, the introduction of artifacts in generated images is unforgivable in the case of medical images. In an attempt to alleviate this drawback, we explore different constraints of the CycleGAN along with investigation of adaptive control of these constraints. The benefits of imposing additional constraints on the CycleGAN, in the form of structure retaining losses is also explored. A generalized frequency loss inspired by arxiv:2012.12821 that preserves content in the frequency domain between source and target is investigated and compared with existing losses such as the MIND loss arXiv:1809.04536. CycleGAN implementations from the ganslate framework (https://github.com/ganslate-team/ganslate) are used for experimentation in this thesis. Synthetic images generated from our methods are quantitatively and qualitatively investigated and outperform the baseline CycleGAN and other approaches. Furthermore, no observable artifacts or loss in image quality is found, which is critical for acceptance of these synthetic images. The synthetic medical images thus generated are also evaluated using domain-specific evaluation and using segmentation as a downstream task, in order to clearly highlight their applicability to clinical workflows.

READ FULL TEXT

page 9

page 19

page 20

page 23

page 26

page 29

page 31

page 41

research
02/05/2019

Reduce Noise in Computed Tomography Image using Adaptive Gaussian Filter

One image processing application that is very helpful for humans is to i...
research
02/20/2023

Simple U-net Based Synthetic Polyp Image Generation: Polyp to Negative and Negative to Polyp

Synthetic polyp generation is a good alternative to overcome the privacy...
research
03/03/2023

Robust Detection Outcome: A Metric for Pathology Detection in Medical Images

Detection of pathologies is a fundamental task in medical imaging and th...
research
06/16/2023

Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback

Generative models capable of capturing nuanced clinical features in medi...
research
10/09/2022

Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains

Multi-modal foundation models are typically trained on millions of pairs...
research
04/18/2022

Detecting Deepfakes with Self-Blended Images

In this paper, we present novel synthetic training data called self-blen...
research
01/28/2022

REET: Robustness Evaluation and Enhancement Toolbox for Computational Pathology

Motivation: Digitization of pathology laboratories through digital slide...

Please sign up or login with your details

Forgot password? Click here to reset