Multi-Robot Distributed Semantic Mapping in Unfamiliar Environments through Online Matching of Learned Representations

03/27/2021
by   Stewart Jamieson, et al.
0

We present a solution to multi-robot distributed semantic mapping of novel and unfamiliar environments. Most state-of-the-art semantic mapping systems are based on supervised learning algorithms that cannot classify novel observations online. While unsupervised learning algorithms can invent labels for novel observations, approaches to detect when multiple robots have independently developed their own labels for the same new class are prone to erroneous or inconsistent matches. These issues worsen as the number of robots in the system increases and prevent fusing the local maps produced by each robot into a consistent global map, which is crucial for cooperative planning and joint mission summarization. Our proposed solution overcomes these obstacles by having each robot learn an unsupervised semantic scene model online and use a multiway matching algorithm to identify consistent sets of matches between learned semantic labels belonging to different robots. Compared to the state of the art, the proposed solution produces 20-60 do not degrade even as many more local maps are fused.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 4

page 6

03/30/2021

Dense Incremental Metric-Semantic Mapping for Multi-Agent Systems via Sparse Gaussian Process Regression

We develop an online probabilistic metric-semantic mapping approach for ...
10/17/2020

Lifelong update of semantic maps in dynamic environments

A robot understands its world through the raw information it senses from...
12/14/2020

Reactive Temporal Logic Planning for Multiple Robots in Unknown Occupancy Grid Maps

This paper proposes a new reactive temporal logic planning algorithm for...
06/28/2021

Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systems

This paper presents Kimera-Multi, the first multi-robot system that (i) ...
08/16/2019

Decentralized Multi-Floor Exploration by a Swarm of Miniature Robots Teaming with Wall-Climbing Units

In this paper, we consider the problem of collectively exploring unknown...
06/28/2021

Multi-Task Learning for Scalable and Dense Multi-Layer Bayesian Map Inference

This paper presents a novel and flexible multi-task multi-layer Bayesian...
07/06/2020

Distributed Consistent Multi-Robot Semantic Localization and Mapping

We present an approach for multi-robot consistent distributed localizati...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.