Adversarial Image Alignment and Interpolation

06/30/2017
by   Viren Jain, et al.
0

Volumetric (3d) images are acquired for many scientific and biomedical purposes using imaging methods such as serial section microscopy, CT scans, and MRI. A frequent step in the analysis and reconstruction of such data is the alignment and registration of images that were acquired in succession along a spatial or temporal dimension. For example, in serial section electron microscopy, individual 2d sections are imaged via electron microscopy and then must be aligned to one another in order to produce a coherent 3d volume. State of the art approaches find image correspondences derived from patch matching and invariant feature detectors, and then solve optimization problems that rigidly or elastically deform series of images into an aligned volume. Here we show how fully convolutional neural networks trained with an adversarial loss function can be used for two tasks: (1) synthesis of missing or damaged image data from adjacent sections, and (2) fine-scale alignment of block-face electron microscopy data. Finally, we show how these two capabilities can be combined in order to produce artificial isotropic volumes from anisotropic image volumes using a super-resolution adversarial alignment and interpolation approach.

READ FULL TEXT

page 5

page 6

page 8

research
12/14/2016

Registering large volume serial-section electron microscopy image sets for neural circuit reconstruction using FFT signal whitening

The detailed reconstruction of neural anatomy for connectomics studies r...
research
07/25/2017

ssEMnet: Serial-section Electron Microscopy Image Registration using a Spatial Transformer Network with Learned Features

The alignment of serial-section electron microscopy (ssEM) images is cri...
research
04/29/2019

Convolutional nets for reconstructing neural circuits from brain images acquired by serial section electron microscopy

Neural circuits can be reconstructed from brain images acquired by seria...
research
11/25/2014

Post-acquisition image based compensation for thickness variation in microscopy section series

Serial section Microscopy is an established method for volumetric anatom...
research
02/01/2020

Estimation of Z-Thickness and XY-Anisotropy of Electron Microscopy Images using Gaussian Processes

Serial section electron microscopy (ssEM) is a widely used technique for...
research
04/23/2019

Chunkflow: Distributed Hybrid Cloud Processing of Large 3D Images by Convolutional Nets

It is now common to process volumetric biomedical images using 3D Convol...
research
08/26/2021

Ultrafast Focus Detection for Automated Microscopy

Recent advances in scientific instruments have resulted in dramatic incr...

Please sign up or login with your details

Forgot password? Click here to reset