Dense Incremental Metric-Semantic Mapping for Multi-Agent Systems via Sparse Gaussian Process Regression

by   Ehsan Zobeidi, et al.

We develop an online probabilistic metric-semantic mapping approach for mobile robot teams relying on streaming RGB-D observations. The generated maps contain full continuous distributional information about the geometric surfaces and semantic labels (e.g., chair, table, wall). Our approach is based on online Gaussian Process (GP) training and inference, and avoids the complexity of GP classification by regressing a truncated signed distance function (TSDF) of the regions occupied by different semantic classes. Online regression is enabled through a sparse pseudo-point approximation of the GP posterior. To scale to large environments, we further consider spatial domain partitioning via an octree data structure with overlapping leaves. An extension to the multi-robot setting is developed by having each robot execute its own online measurement update and then combine its posterior parameters via local weighted geometric averaging with those of its neighbors. This yields a distributed information processing architecture in which the GP map estimates of all robots converge to a common map of the environment while relying only on local one-hop communication. Our experiments demonstrate the effectiveness of the probabilistic metric-semantic mapping technique in 2-D and 3-D environments in both single and multi-robot settings.


page 1

page 12

page 14

page 16

page 17


Distributed Gaussian Process Mapping for Robot Teams with Time-varying Communication

Multi-agent mapping is a fundamentally important capability for autonomo...

Multi-Robot Distributed Semantic Mapping in Unfamiliar Environments through Online Matching of Learned Representations

We present a solution to multi-robot distributed semantic mapping of nov...

GP-Localize: Persistent Mobile Robot Localization using Online Sparse Gaussian Process Observation Model

Central to robot exploration and mapping is the task of persistent local...

Active and Interactive Mapping with Dynamic Gaussian ProcessImplicit Surfaces for Mobile Manipulators

In this paper, we present an interactive probabilistic framework for a m...

Dense 3-D Mapping with Spatial Correlation via Gaussian Filtering

Constructing an occupancy representation of the environment is a fundame...

Smoothing and Mapping using Multiple Robots

Mapping expansive regions is an arduous and often times incomplete when ...

Ensemble of Sparse Gaussian Process Experts for Implicit Surface Mapping with Streaming Data

Creating maps is an essential task in robotics and provides the basis fo...