BioGAN: An unpaired GAN-based image to image translation model for microbiological images

06/09/2023
by   Saber Mirzaee Bafti, et al.
0

A diversified dataset is crucial for training a well-generalized supervised computer vision algorithm. However, in the field of microbiology, generation and annotation of a diverse dataset including field-taken images are time consuming, costly, and in some cases impossible. Image to image translation frameworks allow us to diversify the dataset by transferring images from one domain to another. However, most existing image translation techniques require a paired dataset (original image and its corresponding image in the target domain), which poses a significant challenge in collecting such datasets. In addition, the application of these image translation frameworks in microbiology is rarely discussed. In this study, we aim to develop an unpaired GAN-based (Generative Adversarial Network) image to image translation model for microbiological images, and study how it can improve generalization ability of object detection models. In this paper, we present an unpaired and unsupervised image translation model to translate laboratory-taken microbiological images to field images, building upon the recent advances in GAN networks and Perceptual loss function. We propose a novel design for a GAN model, BioGAN, by utilizing Adversarial and Perceptual loss in order to transform high level features of laboratory-taken images into field images, while keeping their spatial features. The contribution of Adversarial and Perceptual loss in the generation of realistic field images were studied. We used the synthetic field images, generated by BioGAN, to train an object-detection framework, and compared the results with those of an object-detection framework trained with laboratory images; this resulted in up to 68.1 respectively. Codes is publicly available at https://github.com/Kahroba2000/BioGAN.

READ FULL TEXT

page 3

page 4

page 8

page 9

research
08/22/2021

Graph2Pix: A Graph-Based Image to Image Translation Framework

In this paper, we propose a graph-based image-to-image translation frame...
research
08/26/2020

Anime-to-Real Clothing: Cosplay Costume Generation via Image-to-Image Translation

Cosplay has grown from its origins at fan conventions into a billion-dol...
research
10/29/2020

Exploring Generative Adversarial Networks for Image-to-Image Translation in STEM Simulation

The use of accurate scanning transmission electron microscopy (STEM) ima...
research
12/18/2022

A Generalized Framework for Critical Heat Flux Detection Using Unsupervised Image-to-Image Translation

This work proposes a framework developed to generalize Critical Heat Flu...
research
09/26/2019

Unsupervised Image Translation using Adversarial Networks for Improved Plant Disease Recognition

Acquisition of data in task-specific applications of machine learning li...
research
01/21/2020

S^2OMGAN: Shortcut from Remote Sensing Images to Online Maps

Traditional online maps, widely used on Internet such as Google map and ...
research
02/28/2022

MRI-GAN: A Generalized Approach to Detect DeepFakes using Perceptual Image Assessment

DeepFakes are synthetic videos generated by swapping a face of an origin...

Please sign up or login with your details

Forgot password? Click here to reset