Learning Guided Electron Microscopy with Active Acquisition

01/07/2021
by   Lu Mi, et al.
5

Single-beam scanning electron microscopes (SEM) are widely used to acquire massive data sets for biomedical study, material analysis, and fabrication inspection. Datasets are typically acquired with uniform acquisition: applying the electron beam with the same power and duration to all image pixels, even if there is great variety in the pixels' importance for eventual use. Many SEMs are now able to move the beam to any pixel in the field of view without delay, enabling them, in principle, to invest their time budget more effectively with non-uniform imaging. In this paper, we show how to use deep learning to accelerate and optimize single-beam SEM acquisition of images. Our algorithm rapidly collects an information-lossy image (e.g. low resolution) and then applies a novel learning method to identify a small subset of pixels to be collected at higher resolution based on a trade-off between the saliency and spatial diversity. We demonstrate the efficacy of this novel technique for active acquisition by speeding up the task of collecting connectomic datasets for neurobiology by up to an order of magnitude.

READ FULL TEXT

page 9

page 12

page 13

research
01/12/2018

How should a fixed budget of dwell time be spent in scanning electron microscopy to optimize image quality?

In scanning electron microscopy, the achievable image quality is often l...
research
10/29/2018

Compressive Sampling Approach for Image Acquisition with Lensless Endoscope

The lensless endoscope is a promising device designed to image tissues i...
research
02/27/2018

Reconstruction of partially sampled multi-band images - Application to STEM-EELS imaging

Electron microscopy has shown to be a very powerful tool to map the chem...
research
01/30/2019

Resolution enhancement in scanning electron microscopy using deep learning

We report resolution enhancement in scanning electron microscopy (SEM) i...
research
12/23/2015

Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation

Many material and biological samples in scientific imaging are character...
research
10/30/2020

Optimization Algorithm-Based Approach for Modelling Large Deflection of Cantilever Beam Subjected to Tip Load

Beam mechanism and beam theory have attracted substantial attention from...
research
11/06/2019

Randomized Computer Vision Approaches for Pattern Recognition in Timepix and Timepix3 Detectors

Timepix and Timepix3 are hybrid pixel detectors (256× 256 pixels), capab...

Please sign up or login with your details

Forgot password? Click here to reset