Future Localization from an Egocentric Depth Image

09/07/2015
by   Hyun Soo Park, et al.
0

This paper presents a method for future localization: to predict a set of plausible trajectories of ego-motion given a depth image. We predict paths avoiding obstacles, between objects, even paths turning around a corner into space behind objects. As a byproduct of the predicted trajectories of ego-motion, we discover in the image the empty space occluded by foreground objects. We use no image based features such as semantic labeling/segmentation or object detection/recognition for this algorithm. Inspired by proxemics, we represent the space around a person using an EgoSpace map, akin to an illustrated tourist map, that measures a likelihood of occlusion at the egocentric coordinate system. A future trajectory of ego-motion is modeled by a linear combination of compact trajectory bases allowing us to constrain the predicted trajectory. We learn the relationship between the EgoSpace map and trajectory from the EgoMotion dataset providing in-situ measurements of the future trajectory. A cost function that takes into account partial occlusion due to foreground objects is minimized to predict a trajectory. This cost function generates a trajectory that passes through the occluded space, which allows us to discover the empty space behind the foreground objects. We quantitatively evaluate our method to show predictive validity and apply to various real world scenes including walking, shopping, and social interactions.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

research
12/04/2017

3D Semantic Trajectory Reconstruction from 3D Pixel Continuum

This paper presents a method to reconstruct dense semantic trajectory st...
research
02/28/2020

Predicting Sharp and Accurate Occlusion Boundaries in Monocular Depth Estimation Using Displacement Fields

Current methods for depth map prediction from monocular images tend to p...
research
07/29/2019

Silhouette Guided Point Cloud Reconstruction beyond Occlusion

One major challenge in 3D reconstruction is to infer the complete shape ...
research
05/29/2015

Salient Object Detection via Augmented Hypotheses

In this paper, we propose using augmented hypotheses which consider obje...
research
02/11/2022

SafePicking: Learning Safe Object Extraction via Object-Level Mapping

Robots need object-level scene understanding to manipulate objects while...
research
10/26/2022

Planning with Occluded Traffic Agents using Bi-Level Variational Occlusion Models

Reasoning with occluded traffic agents is a significant open challenge f...
research
05/14/2022

RiCS: A 2D Self-Occlusion Map for Harmonizing Volumetric Objects

There have been remarkable successes in computer vision with deep learni...

Please sign up or login with your details

Forgot password? Click here to reset