Multi-modal Image Registration for Correlative Microscopy

11/12/2014
by   Tian Cao, et al.
0

Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies. Image registration for correlative microscopy is quite challenging because it is a multi-modal, multi-scale and multi-dimensional registration problem. In this report, I introduce two methods of image registration for correlative microscopy. The first method is based on fiducials (beads). I generate landmarks from the fiducials and compute the similarity transformation matrix based on three pairs of nearest corresponding landmarks. A least-squares matching process is applied afterwards to further refine the registration. The second method is inspired by the image analogies approach. I introduce the sparse representation model into image analogies. I first train representative image patches (dictionaries) for pre-registered datasets from two different modalities, and then I use the sparse coding technique to transfer a given image to a predicted image from one modality to another based on the learned dictionaries. The final image registration is between the predicted image and the original image corresponding to the given image in the different modality. The method transforms a multi-modal registration problem to a mono-modal one. I test my approaches on Transmission Electron Microscopy (TEM) and confocal microscopy images. Experimental results of the methods are also shown in this report.

READ FULL TEXT

page 2

page 5

page 6

page 14

page 16

page 17

page 18

page 19

research
03/18/2020

Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation

Many applications, such as autonomous driving, heavily rely on multi-mod...
research
11/10/2021

A Structure Feature Algorithm for Multi-modal Forearm Registration

Augmented reality technology based on image registration is becoming inc...
research
02/26/2015

Coercive Region-level Registration for Multi-modal Images

We propose a coercive approach to simultaneously register and segment mu...
research
12/07/2017

Parallel Prefix Algorithms for the Registration of Arbitrarily Long Electron Micrograph Series

Recent advances in the technology of transmission electron microscopy ha...
research
10/23/2020

Work-stealing prefix scan: Addressing load imbalance in large-scale image registration

Parallelism patterns (e.g., map or reduce) have proven to be effective t...
research
07/29/2018

Towards ultra-high resolution 3D reconstruction of a whole rat brain from 3D-PLI data

3D reconstruction of the fiber connectivity of the rat brain at microsco...
research
01/28/2013

Image registration with sparse approximations in parametric dictionaries

We examine in this paper the problem of image registration from the new ...

Please sign up or login with your details

Forgot password? Click here to reset