A Theory for Optical flow-based Transport on Image Manifolds

11/22/2011
by   Sriram Nagaraj, et al.
0

An image articulation manifold (IAM) is the collection of images formed when an object is articulated in front of a camera. IAMs arise in a variety of image processing and computer vision applications, where they provide a natural low-dimensional embedding of the collection of high-dimensional images. To date IAMs have been studied as embedded submanifolds of Euclidean spaces. Unfortunately, their promise has not been realized in practice, because real world imagery typically contains sharp edges that render an IAM non-differentiable and hence non-isometric to the low-dimensional parameter space under the Euclidean metric. As a result, the standard tools from differential geometry, in particular using linear tangent spaces to transport along the IAM, have limited utility. In this paper, we explore a nonlinear transport operator for IAMs based on the optical flow between images and develop new analytical tools reminiscent of those from differential geometry using the idea of optical flow manifolds (OFMs). We define a new metric for IAMs that satisfies certain local isometry conditions, and we show how to use this metric to develop a new tools such as flow fields on IAMs, parallel flow fields, parallel transport, as well as a intuitive notion of curvature. The space of optical flow fields along a path of constant curvature has a natural multi-scale structure via a monoid structure on the space of all flow fields along a path. We also develop lower bounds on approximation errors while approximating non-parallel flow fields by parallel flow fields.

READ FULL TEXT

page 3

page 7

page 8

page 9

page 15

research
04/13/2021

MESD: Exploring Optical Flow Assessment on Edge of Motion Objects with Motion Edge Structure Difference

The optical flow estimation has been assessed in various applications. I...
research
12/28/2021

360° Optical Flow using Tangent Images

Omnidirectional 360 images have found many promising and exciting applic...
research
12/02/2021

Dimensions of Motion: Learning to Predict a Subspace of Optical Flow from a Single Image

We introduce the problem of predicting, from a single video frame, a low...
research
11/11/2015

Principal Autoparallel Analysis: Data Analysis in Weitzenböck Space

The statistical analysis of data lying on a differentiable, locally Eucl...
research
01/18/2023

Deep Dynamic Scene Deblurring from Optical Flow

Deblurring can not only provide visually more pleasant pictures and make...
research
12/16/2013

Decomposition of Optical Flow on the Sphere

We propose a number of variational regularisation methods for the estima...
research
09/03/2020

Computational Analysis of Deformable Manifolds: from Geometric Modelling to Deep Learning

Leo Tolstoy opened his monumental novel Anna Karenina with the now famou...

Please sign up or login with your details

Forgot password? Click here to reset