Exploring Generative Adversarial Networks for Image-to-Image Translation in STEM Simulation

by   Nick Lawrence, et al.

The use of accurate scanning transmission electron microscopy (STEM) image simulation methods require large computation times that can make their use infeasible for the simulation of many images. Other simulation methods based on linear imaging models, such as the convolution method, are much faster but are too inaccurate to be used in application. In this paper, we explore deep learning models that attempt to translate a STEM image produced by the convolution method to a prediction of the high accuracy multislice image. We then compare our results to those of regression methods. We find that using the deep learning model Generative Adversarial Network (GAN) provides us with the best results and performs at a similar accuracy level to previous regression models on the same dataset. Codes and data for this project can be found in this GitHub repository, https://github.com/uw-cmg/GAN-STEM-Conv2MultiSlice.



There are no comments yet.


page 6


OmiTrans: generative adversarial networks based omics-to-omics translation framework

With the rapid development of high-throughput experimental technologies,...

Cartoon-to-real: An Approach to Translate Cartoon to Realistic Images using GAN

We propose a method to translate cartoon images to real world images usi...

Generative Adversarial Networks for Astronomical Images Generation

Space exploration has always been a source of inspiration for humankind,...

UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation

Image-to-image translation has broad applications in art, design, and sc...

Style-Restricted GAN: Multi-Modal Translation with Style Restriction Using Generative Adversarial Networks

Unpaired image-to-image translation using Generative Adversarial Network...

Microscopy Cell Segmentation via Adversarial Neural Networks

We present a novel approach for the segmentation of microscopy images. T...

ICAM-reg: Interpretable Classification and Regression with Feature Attribution for Mapping Neurological Phenotypes in Individual Scans

An important goal of medical imaging is to be able to precisely detect p...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.