Autonomous Search of Semantic Objects in Unknown Environments

02/26/2023
by   Zhentian Qian, et al.
0

This paper addresses the problem of enabling a robot to search for a semantic object in an unknown and GPS-denied environment. For the robot in the unknown environment to detect and find the target object, it must perform simultaneous localization and mapping (SLAM) at both geometric and semantic levels using its onboard sensors while planning and executing its motion based on the ever-updated SLAM results. In other words, the robot must be able to conduct simultaneous localization, semantic mapping, motion planning, and execution in real-time in the presence of sensing and motion uncertainty. This is an open problem as it combines semantic SLAM based on perception and real-time motion planning and execution under uncertainty. Moreover, the goals of robot motion change on the fly depending on whether and how the robot can detect the target object. We propose a novel approach to tackle the problem, leveraging semantic SLAM, Bayesian Networks, Markov Decision Process, and real-time dynamic planning. The results demonstrate the effectiveness and efficiency of our approach.

READ FULL TEXT

page 2

page 3

page 4

page 6

research
11/20/2020

Semantic SLAM with Autonomous Object-Level Data Association

It is often desirable to capture and map semantic information of an envi...
research
09/17/2022

PlaneSLAM: Plane-based LiDAR SLAM for Motion Planning in Structured 3D Environments

LiDAR sensors are a powerful tool for robot simultaneous localization an...
research
09/20/2023

Integrating Visual Foundation Models for Enhanced Robot Manipulation and Motion Planning: A Layered Approach

This paper presents a novel layered framework that integrates visual fou...
research
03/30/2022

GTP-SLAM: Game-Theoretic Priors for Simultaneous Localization and Mapping in Multi-Agent Scenarios

Robots operating in complex, multi-player settings must simultaneously m...
research
03/06/2018

Methodology to analyze the accuracy of 3D objects reconstructed with collaborative robot based monocular LSD-SLAM

SLAM systems are mainly applied for robot navigation while research on f...
research
03/12/2023

A Systematic Evaluation of Different Indoor Localization Methods in Robotic Autonomous Luggage Trolley Collection at Airports

This article addresses the localization problem in robotic autonomous lu...
research
08/30/2018

A Variational Feature Encoding Method of 3D Object for Probabilistic Semantic SLAM

This paper presents a feature encoding method of complex 3D objects for ...

Please sign up or login with your details

Forgot password? Click here to reset