3D Scene Geometry-Aware Constraint for Camera Localization with Deep Learning

05/13/2020
by   Mi Tian, et al.
0

Camera localization is a fundamental and key component of autonomous driving vehicles and mobile robots to localize themselves globally for further environment perception, path planning and motion control. Recently end-to-end approaches based on convolutional neural network have been much studied to achieve or even exceed 3D-geometry based traditional methods. In this work, we propose a compact network for absolute camera pose regression. Inspired from those traditional methods, a 3D scene geometry-aware constraint is also introduced by exploiting all available information including motion, depth and image contents. We add this constraint as a regularization term to our proposed network by defining a pixel-level photometric loss and an image-level structural similarity loss. To benchmark our method, different challenging scenes including indoor and outdoor environment are tested with our proposed approach and state-of-the-arts. And the experimental results demonstrate significant performance improvement of our method on both prediction accuracy and convergence efficiency.

READ FULL TEXT
11/28/2017

Learning Less is More - 6D Camera Localization via 3D Surface Regression

Popular research areas like autonomous driving and augmented reality hav...
01/04/2019

Relative Geometry-Aware Siamese Neural Network for 6DOF Camera Relocalization

6DOF camera relocalization is an important component of autonomous drivi...
07/16/2018

ENG: End-to-end Neural Geometry for Robust Depth and Pose Estimation using CNNs

Recovering structure and motion parameters given a image pair or a seque...
07/01/2021

Deep auxiliary learning for visual localization using colorization task

Visual localization is one of the most important components for robotics...
10/29/2020

An End to End Network Architecture for Fundamental Matrix Estimation

In this paper, we present a novel end-to-end network architecture to est...
10/24/2020

Improving the generalization of network based relative pose regression: dimension reduction as a regularizer

Visual localization occupies an important position in many areas such as...
07/13/2022

6D Camera Relocalization in Visually Ambiguous Extreme Environments

We propose a novel method to reliably estimate the pose of a camera give...