LaLaLoc: Latent Layout Localisation in Dynamic, Unvisited Environments

04/19/2021
by   Henry Howard-Jenkins, et al.
0

We present LaLaLoc to localise in environments without the need for prior visitation, and in a manner that is robust to large changes in scene appearance, such as a full rearrangement of furniture. Specifically, LaLaLoc performs localisation through latent representations of room layout. LaLaLoc learns a rich embedding space shared between RGB panoramas and layouts inferred from a known floor plan that encodes the structural similarity between locations. Further, LaLaLoc introduces direct, cross-modal pose optimisation in its latent space. Thus, LaLaLoc enables fine-grained pose estimation in a scene without the need for prior visitation, as well as being robust to dynamics, such as a change in furniture configuration. We show that in a domestic environment LaLaLoc is able to accurately localise a single RGB panorama image to within 8.3cm, given only a floor plan as a prior.

READ FULL TEXT
research
03/30/2018

Cross-modal Deep Variational Hand Pose Estimation

The human hand moves in complex and high-dimensional ways, making estima...
research
08/04/2020

Unsupervised Cross-Modal Alignment for Multi-Person 3D Pose Estimation

We present a deployment friendly, fast bottom-up framework for multi-per...
research
03/23/2021

Shared Latent Space of Font Shapes and Impressions

We have specific impressions from the style of a typeface (font), sugges...
research
08/05/2022

Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garment

For visual manipulation tasks, we aim to represent image content with se...
research
06/11/2019

Clouds of Oriented Gradients for 3D Detection of Objects, Surfaces, and Indoor Scene Layouts

We develop new representations and algorithms for three-dimensional (3D)...
research
05/01/2021

Sparse Pose Trajectory Completion

We propose a method to learn, even using a dataset where objects appear ...
research
12/12/2021

360-DFPE: Leveraging Monocular 360-Layouts for Direct Floor Plan Estimation

We present 360-DFPE, a sequential floor plan estimation method that dire...

Please sign up or login with your details

Forgot password? Click here to reset