CPO: Change Robust Panorama to Point Cloud Localization

07/12/2022
by   Junho Kim, et al.
4

We present CPO, a fast and robust algorithm that localizes a 2D panorama with respect to a 3D point cloud of a scene possibly containing changes. To robustly handle scene changes, our approach deviates from conventional feature point matching, and focuses on the spatial context provided from panorama images. Specifically, we propose efficient color histogram generation and subsequent robust localization using score maps. By utilizing the unique equivariance of spherical projections, we propose very fast color histogram generation for a large number of camera poses without explicitly rendering images for all candidate poses. We accumulate the regional consistency of the panorama and point cloud as 2D/3D score maps, and use them to weigh the input color values to further increase robustness. The weighted color distribution quickly finds good initial poses and achieves stable convergence for gradient-based optimization. CPO is lightweight and achieves effective localization in all tested scenarios, showing stable performance despite scene changes, repetitive structures, or featureless regions, which are typical challenges for visual localization with perspective cameras.

READ FULL TEXT

page 2

page 6

page 8

page 11

research
08/14/2021

PICCOLO: Point Cloud-Centric Omnidirectional Localization

We present PICCOLO, a simple and efficient algorithm for omnidirectional...
research
07/21/2022

MeshLoc: Mesh-Based Visual Localization

Visual localization, i.e., the problem of camera pose estimation, is a c...
research
10/13/2021

ADOP: Approximate Differentiable One-Pixel Point Rendering

We present a novel point-based, differentiable neural rendering pipeline...
research
07/18/2023

EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Maps

Accurate and reliable ego-localization is critical for autonomous drivin...
research
03/20/2022

Lateral Ego-Vehicle Control without Supervision using Point Clouds

Existing vision based supervised approaches to lateral vehicle control a...
research
01/16/2021

Shape Back-Projection In 3D Scenes

In this work, we propose a novel framework shape back-projection for com...

Please sign up or login with your details

Forgot password? Click here to reset