Deep Learning Supersampled Scanning Transmission Electron Microscopy

10/23/2019
by   Jeffrey M. Ede, et al.
16

Compressed sensing can increase resolution, and decrease electron dose and scan time of electron microscope point-scan systems with minimal information loss. Building on a history of successful deep learning applications in compressed sensing, we have developed a two-stage multiscale generative adversarial network to supersample scanning transmission electron micrographs with point-scan coverage reduced to 1/16, 1/25, ..., 1/100 px. We propose a novel non-adversarial learning policy to train a unified generator for multiple coverages and introduce an auxiliary network to homogenize prioritization of training data with varied signal-to-noise ratios. This achieves root mean square errors of 3.23% and 4.54% at 1/16 px and 1/100 px coverage, respectively; within 1% of errors for networks trained for each coverage individually. Detailed error distributions are presented for unified and individual coverage generators, including errors per output pixel. In addition, we present a baseline one-stage network for a single coverage and investigate numerical precision for web serving. Source code, training data, and pretrained models are publicly available at https://github.com/Jeffrey-Ede/DLSS-STEM

READ FULL TEXT

page 11

page 12

page 13

page 14

page 15

page 17

page 18

page 19

research
04/06/2020

Adaptive Partial Scanning Transmission Electron Microscopy with Reinforcement Learning

Compressed sensing is applied to scanning transmission electron microsco...
research
01/04/2021

Advances in Electron Microscopy with Deep Learning

This doctoral thesis covers some of my advances in electron microscopy w...
research
05/31/2019

Partial Scan Electron Microscopy with Deep Learning

We present a multi-scale conditional generative adversarial network that...
research
03/19/2019

Compressed Sensing: From Research to Clinical Practice with Data-Driven Learning

Compressed sensing in MRI enables high subsampling factors while maintai...
research
02/22/2022

Computing Multiple Image Reconstructions with a Single Hypernetwork

Deep learning based techniques achieve state-of-the-art results in a wid...
research
04/10/2023

Localise to segment: crop to improve organ at risk segmentation accuracy

Increased organ at risk segmentation accuracy is required to reduce cost...

Please sign up or login with your details

Forgot password? Click here to reset