ssEMnet: Serial-section Electron Microscopy Image Registration using a Spatial Transformer Network with Learned Features

07/25/2017
by   Inwan Yoo, et al.
0

The alignment of serial-section electron microscopy (ssEM) images is critical for efforts in neuroscience that seek to reconstruct neuronal circuits. However, each ssEM plane contains densely packed structures that vary from one section to the next, which makes matching features across images a challenge. Advances in deep learning has resulted in unprecedented performance in similar computer vision problems, but to our knowledge, they have not been successfully applied to ssEM image co-registration. In this paper, we introduce a novel deep network model that combines a spatial transformer for image deformation and a convolutional autoencoder for unsupervised feature learning for robust ssEM image alignment. This results in improved accuracy and robustness while requiring substantially less user intervention than conventional methods. We evaluate our method by comparing registration quality across several datasets.

READ FULL TEXT

page 3

page 6

page 7

research
06/30/2017

Adversarial Image Alignment and Interpolation

Volumetric (3d) images are acquired for many scientific and biomedical p...
research
12/14/2016

Registering large volume serial-section electron microscopy image sets for neural circuit reconstruction using FFT signal whitening

The detailed reconstruction of neural anatomy for connectomics studies r...
research
04/29/2019

Convolutional nets for reconstructing neural circuits from brain images acquired by serial section electron microscopy

Neural circuits can be reconstructed from brain images acquired by seria...
research
09/04/2020

Improving axial resolution in SIM using deep learning

Structured Illumination Microscopy is a widespread methodology to image ...
research
07/22/2019

Image-and-Spatial Transformer Networks for Structure-Guided Image Registration

Image registration with deep neural networks has become an active field ...
research
02/01/2020

Estimation of Z-Thickness and XY-Anisotropy of Electron Microscopy Images using Gaussian Processes

Serial section electron microscopy (ssEM) is a widely used technique for...
research
02/21/2022

Deep Feature based Cross-slide Registration

Cross-slide image analysis provides additional information by analysing ...

Please sign up or login with your details

Forgot password? Click here to reset