A Study of Image Analysis with Tangent Distance

01/11/2014
by   Elif Vural, et al.
0

The computation of the geometric transformation between a reference and a target image, known as registration or alignment, corresponds to the projection of the target image onto the transformation manifold of the reference image (the set of images generated by its geometric transformations). It, however, often takes a nontrivial form such that the exact computation of projections on the manifold is difficult. The tangent distance method is an effective algorithm to solve this problem by exploiting a linear approximation of the manifold. As theoretical studies about the tangent distance algorithm have been largely overlooked, we present in this work a detailed performance analysis of this useful algorithm, which can eventually help its implementation. We consider a popular image registration setting using a multiscale pyramid of lowpass filtered versions of the (possibly noisy) reference and target images, which is particularly useful for recovering large transformations. We first show that the alignment error has a nonmonotonic variation with the filter size, due to the opposing effects of filtering on both manifold nonlinearity and image noise. We then study the convergence of the multiscale tangent distance method to the optimal solution. We finally examine the performance of the tangent distance method in image classification applications. Our theoretical findings are confirmed by experiments on image transformation models involving translations, rotations and scalings. Our study is the first detailed study of the tangent distance algorithm that leads to a better understanding of its efficacy and to the proper selection of its design parameters.

READ FULL TEXT
research
01/28/2013

Image registration with sparse approximations in parametric dictionaries

We examine in this paper the problem of image registration from the new ...
research
12/23/2011

Discretization of Parametrizable Signal Manifolds

Transformation-invariant analysis of signals often requires the computat...
research
12/23/2011

Learning Smooth Pattern Transformation Manifolds

Manifold models provide low-dimensional representations that are useful ...
research
11/09/2022

3DFill:Reference-guided Image Inpainting by Self-supervised 3D Image Alignment

Most existing image inpainting algorithms are based on a single view, st...
research
04/15/2021

Semisupervised Manifold Alignment of Multimodal Remote Sensing Images

We introduce a method for manifold alignment of different modalities (or...
research
09/06/2019

Astroalign: A Python module for astronomical image registration

We present an algorithm implemented in the astroalign Python module for ...
research
01/22/2019

Linearized Multi-Sampling for Differentiable Image Transformation

We propose a novel image sampling method for differentiable image transf...

Please sign up or login with your details

Forgot password? Click here to reset