Risk-aware Meta-level Decision Making for Exploration Under Uncertainty

09/12/2022
by   Joshua Ott, et al.
0

Robotic exploration of unknown environments is fundamentally a problem of decision making under uncertainty where the robot must account for uncertainty in sensor measurements, localization, action execution, as well as many other factors. For large-scale exploration applications, autonomous systems must overcome the challenges of sequentially deciding which areas of the environment are valuable to explore while safely evaluating the risks associated with obstacles and hazardous terrain. In this work, we propose a risk-aware meta-level decision making framework to balance the tradeoffs associated with local and global exploration. Meta-level decision making builds upon classical hierarchical coverage planners by switching between local and global policies with the overall objective of selecting the policy that is most likely to maximize reward in a stochastic environment. We use information about the environment history, traversability risk, and kinodynamic constraints to reason about the probability of successful policy execution to switch between local and global policies. We have validated our solution in both simulation and on a variety of large-scale real world hardware tests. Our results show that by balancing local and global exploration we are able to significantly explore large-scale environments more efficiently.

READ FULL TEXT

page 3

page 20

page 21

research
02/10/2021

PLGRIM: Hierarchical Value Learning for Large-scale Exploration in Unknown Environments

In order for a robot to explore an unknown environment autonomously, it ...
research
02/06/2023

Adaptive Coverage Path Planning for Efficient Exploration of Unknown Environments

We present a method for solving the coverage problem with the objective ...
research
05/11/2021

Zero-Shot Reinforcement Learning on Graphs for Autonomous Exploration Under Uncertainty

This paper studies the problem of autonomous exploration under localizat...
research
03/06/2023

Large-Scale Exploration of Cave Environments by Unmanned Aerial Vehicles

This paper presents a self-contained system for the robust utilization o...
research
04/02/2023

Risk-Sensitive and Robust Model-Based Reinforcement Learning and Planning

Many sequential decision-making problems that are currently automated, s...
research
07/24/2020

Autonomous Exploration Under Uncertainty via Deep Reinforcement Learning on Graphs

We consider an autonomous exploration problem in which a range-sensing m...
research
01/02/2023

Bayesian Generalized Kernel Inference for Exploration of Autonomous Robots

This paper concerns realizing highly efficient information-theoretic rob...

Please sign up or login with your details

Forgot password? Click here to reset