Continuous Direct Sparse Visual Odometry from RGB-D Images

by   Maani Ghaffari, et al.

This paper reports on a novel formulation and evaluation of visual odometry from RGB-D images. Assuming a static scene, the developed theoretical framework generalizes the widely used direct energy formulation (photometric error minimization) technique for obtaining a rigid body transformation that aligns two overlapping RGB-D images to a continuous formulation. The continuity is achieved through functional treatment of the problem and representing the process models over RGB-D images in a reproducing kernel Hilbert space; consequently, the registration is not limited to the specific image resolution and the framework is fully analytical with a closed-form derivation of the gradient. We solve the problem by maximizing the inner product between two functions defined over RGB-D images, while the continuous action of the rigid body motion Lie group is captured through the integration of the flow in the corresponding Lie algebra. Energy-based approaches have been extremely successful and the developed framework in this paper shares many of their desired properties such as the parallel structure on both CPUs and GPUs, sparsity, semi-dense tracking, avoiding explicit data association which is computationally expensive, and possible extensions to the simultaneous localization and mapping frameworks. The evaluations on experimental data and comparison with the energy-based formulation of the problem confirm the effectiveness of the proposed technique, especially, when the lack of structure and texture in the environment is evident.


Nonparametric Continuous Sensor Registration

This paper develops a new mathematical framework that enables nonparamet...

A Keyframe-based Continuous Visual SLAM for RGB-D Cameras via Nonparametric Joint Geometric and Appearance Representation

This paper reports on a robust RGB-D SLAM system that performs well in s...

Visual Odometry for RGB-D Cameras

Visual odometry is the process of estimating the position and orientatio...

Adaptive Continuous Visual Odometry from RGB-D Images

In this paper, we extend the recently developed continuous visual odomet...

SalientDSO: Bringing Attention to Direct Sparse Odometry

Although cluttered indoor scenes have a lot of useful high-level semanti...

RGB-Topography and X-rays Image Registration for Idiopathic Scoliosis Children Patient Follow-up

Children diagnosed with a scoliosis pathology are exposed during their f...

Semi-Dense Visual Odometry for RGB-D Cameras Using Approximate Nearest Neighbour Fields

This paper presents a robust and efficient semi-dense visual odometry so...

Please sign up or login with your details

Forgot password? Click here to reset