Global Voxel Transformer Networks for Augmented Microscopy

08/05/2020
by   Zhengyang Wang, et al.
107

Advances in deep learning have led to remarkable success in augmented microscopy, enabling us to obtain high-quality microscope images without using expensive microscopy hardware and sample preparation techniques. However, current deep learning models for augmented microscopy are mostly U-Net based neural networks, thus sharing certain drawbacks that limit the performance. In this work, we introduce global voxel transformer networks (GVTNets), an advanced deep learning tool for augmented microscopy that overcomes intrinsic limitations of the current U-Net based models and achieves improved performance. GVTNets are built on global voxel transformer operators (GVTOs), which are able to aggregate global information, as opposed to local operators like convolutions. We apply the proposed methods on existing datasets for three different augmented microscopy tasks under various settings. The performance is significantly and consistently better than previous U-Net based approaches.

READ FULL TEXT

page 4

page 7

page 9

page 10

page 12

research
10/14/2021

3D Structure from 2D Microscopy images using Deep Learning

Understanding the structure of a protein complex is crucial indeterminin...
research
10/08/2020

Free annotated data for deep learning in microscopy? A hitchhiker's guide

In microscopy, the time burden and cost of acquiring and annotating larg...
research
07/01/2019

Global Transformer U-Nets for Label-Free Prediction of Fluorescence Images

Visualizing the details of different cellular structures is of great imp...
research
01/12/2021

CleftNet: Augmented Deep Learning for Synaptic Cleft Detection from Brain Electron Microscopy

Detecting synaptic clefts is a crucial step to investigate the biologica...
research
09/17/2020

Review: Deep Learning in Electron Microscopy

Deep learning is transforming most areas of science and technology, incl...
research
08/03/2021

From augmented microscopy to the topological transformer: a new approach in cell image analysis for Alzheimer's research

Cell image analysis is crucial in Alzheimer's research to detect the pre...
research
09/21/2019

Learning Dense Voxel Embeddings for 3D Neuron Reconstruction

We show dense voxel embeddings learned via deep metric learning can be e...

Please sign up or login with your details

Forgot password? Click here to reset