Multi-Robot Distributed Semantic Mapping in Unfamiliar Environments through Online Matching of Learned Representations

by   Stewart Jamieson, et al.

We present a solution to multi-robot distributed semantic mapping of novel and unfamiliar environments. Most state-of-the-art semantic mapping systems are based on supervised learning algorithms that cannot classify novel observations online. While unsupervised learning algorithms can invent labels for novel observations, approaches to detect when multiple robots have independently developed their own labels for the same new class are prone to erroneous or inconsistent matches. These issues worsen as the number of robots in the system increases and prevent fusing the local maps produced by each robot into a consistent global map, which is crucial for cooperative planning and joint mission summarization. Our proposed solution overcomes these obstacles by having each robot learn an unsupervised semantic scene model online and use a multiway matching algorithm to identify consistent sets of matches between learned semantic labels belonging to different robots. Compared to the state of the art, the proposed solution produces 20-60 do not degrade even as many more local maps are fused.



There are no comments yet.


page 1

page 3

page 4

page 6


Dense Incremental Metric-Semantic Mapping for Multi-Agent Systems via Sparse Gaussian Process Regression

We develop an online probabilistic metric-semantic mapping approach for ...

Lifelong update of semantic maps in dynamic environments

A robot understands its world through the raw information it senses from...

Reactive Temporal Logic Planning for Multiple Robots in Unknown Occupancy Grid Maps

This paper proposes a new reactive temporal logic planning algorithm for...

Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systems

This paper presents Kimera-Multi, the first multi-robot system that (i) ...

Decentralized Multi-Floor Exploration by a Swarm of Miniature Robots Teaming with Wall-Climbing Units

In this paper, we consider the problem of collectively exploring unknown...

Multi-Task Learning for Scalable and Dense Multi-Layer Bayesian Map Inference

This paper presents a novel and flexible multi-task multi-layer Bayesian...

Distributed Consistent Multi-Robot Semantic Localization and Mapping

We present an approach for multi-robot consistent distributed localizati...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.