Active Metric-Semantic Mapping by Multiple Aerial Robots

09/18/2022
by   Xu Liu, et al.
0

Traditional approaches for active mapping focus on building geometric maps. For most real-world applications, however, actionable information is related to semantically meaningful objects in the environment. We propose an approach to the active metric-semantic mapping problem that enables multiple heterogeneous robots to collaboratively build a map of the environment. The robots actively explore to minimize the uncertainties in both semantic (object classification) and geometric (object modeling) information. We represent the environment using informative but sparse object models, each consisting of a basic shape and a semantic class label, and characterize uncertainties empirically using a large amount of real-world data. Given a prior map, we use this model to select actions for each robot to minimize uncertainties. The performance of our algorithm is demonstrated through multi-robot experiments in diverse real-world environments. The proposed framework is applicable to a wide range of real-world problems, such as precision agriculture, infrastructure inspection, and asset mapping in factories. A demo video can be found at https://youtu.be/S86SgXi54oU.

READ FULL TEXT

page 1

page 2

page 3

research
09/13/2023

3D Active Metric-Semantic SLAM

In this letter, we address the problem of exploration and metric-semanti...
research
03/01/2019

Volumetric Instance-Aware Semantic Mapping and 3D Object Discovery

To autonomously navigate and plan interactions in real-world environment...
research
02/10/2022

Robophysical modeling of spacetime dynamics

Systems consisting of spheres rolling on elastic membranes have been use...
research
09/20/2022

Information-theoretic Abstraction of Semantic Octree Models for Integrated Perception and Planning

In this paper, we develop an approach that enables autonomous robots to ...
research
06/14/2023

Toward Grounded Social Reasoning

Consider a robot tasked with tidying a desk with a meticulously construc...
research
02/22/2020

Actively Mapping Industrial Structures with Information Gain-Based Planning on a Quadruped Robot

In this paper, we develop an online active mapping system to enable a qu...
research
08/23/2022

Robot Active Neural Sensing and Planning in Unknown Cluttered Environments

Active sensing and planning in unknown, cluttered environments is an ope...

Please sign up or login with your details

Forgot password? Click here to reset