Visual-Inertial Object Detection and Mapping

06/22/2018
by   Xiaohan Fei, et al.
0

We present a method to populate an unknown environment with models of previously seen objects, placed in a Euclidean reference frame that is inferred causally and on-line using monocular video along with inertial sensors. The system we implement returns a sparse point cloud for the regions of the scene that are visible but not recognized as a previously seen object, and a detailed object model and its pose in the Euclidean frame otherwise. The system includes bottom-up and top-down components, whereby deep networks trained for detection provide likelihood scores for object hypotheses provided by a nonlinear filter, whose state serves as memory. Additional networks provide likelihood scores for edges, which complements detection networks trained to be invariant to small deformations. We test our algorithm on existing datasets, and also introduce the VISMA dataset, that provides ground truth pose, point-cloud map, and object models, along with time-stamped inertial measurements.

READ FULL TEXT

page 10

page 12

page 13

research
06/13/2016

Visual-Inertial-Semantic Scene Representation for 3-D Object Detection

We describe a system to detect objects in three-dimensional space using ...
research
04/16/2020

Leveraging Planar Regularities for Point Line Visual-Inertial Odometry

With monocular Visual-Inertial Odometry (VIO) system, 3D point cloud and...
research
09/06/2020

A Robust Laser-Inertial Odometry and Mapping Method for Large-Scale Highway Environments

In this paper, we propose a novel laser-inertial odometry and mapping me...
research
08/02/2021

Investigating Attention Mechanism in 3D Point Cloud Object Detection

Object detection in three-dimensional (3D) space attracts much interest ...
research
09/26/2022

Feature-based model selection for object detection from point cloud data

Smart monitoring using three-dimensional (3D) image sensors has been att...
research
11/05/2020

GPR-based Model Reconstruction System for Underground Utilities Using GPRNet

Ground Penetrating Radar (GPR) is one of the most important non-destruct...
research
11/24/2021

Automatic Mapping with Obstacle Identification for Indoor Human Mobility Assessment

We propose a framework that allows a mobile robot to build a map of an i...

Please sign up or login with your details

Forgot password? Click here to reset