FishNet: A Camera Localizer using Deep Recurrent Networks

04/22/2019
by   Hsin-I Chen, et al.
12

This paper proposes a robust localization system that employs deep learning for better scene representation, and enhances the accuracy of 6-DOF camera pose estimation. Inspired by the fact that global scene structure can be revealed by wide field-of-view, we leverage the large overlap of a fisheye camera between adjacent frames, and the powerful high-level feature representations of deep learning. Our main contribution is the novel network architecture that extracts both temporal and spatial information using a Recurrent Neural Network. Specifically, we propose a novel pose regularization term combined with LSTM. This leads to smoother pose estimation, especially for large outdoor scenery. Promising experimental results on three benchmark datasets manifest the effectiveness of the proposed approach.

READ FULL TEXT

page 2

page 6

page 10

page 11

page 14

research
04/26/2023

Graph-CoVis: GNN-based Multi-view Panorama Global Pose Estimation

In this paper, we address the problem of wide-baseline camera pose estim...
research
11/19/2018

Indoor GeoNet: Weakly Supervised Hybrid Learning for Depth and Pose Estimation

Humans naturally perceive a 3D scene in front of them through accumulati...
research
10/09/2022

Robustifying the Multi-Scale Representation of Neural Radiance Fields

Neural Radiance Fields (NeRF) recently emerged as a new paradigm for obj...
research
05/05/2022

ImPosIng: Implicit Pose Encoding for Efficient Camera Pose Estimation

We propose a novel learning-based formulation for camera pose estimation...
research
05/13/2018

DeLS-3D: Deep Localization and Segmentation with a 3D Semantic Map

For applications such as autonomous driving, self-localization/camera po...
research
08/23/2021

ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation

This paper presents an innovative deep learning pipeline which estimates...
research
10/01/2020

Can You Trust Your Pose? Confidence Estimation in Visual Localization

Camera pose estimation in large-scale environments is still an open ques...

Please sign up or login with your details

Forgot password? Click here to reset