Learned Parameter Selection for Robotic Information Gathering

03/09/2023
by   Christopher Denniston, et al.
0

When robots are deployed in the field for environmental monitoring they typically execute pre-programmed motions, such as lawnmower paths, instead of adaptive methods, such as informative path planning. One reason for this is that adaptive methods are dependent on parameter choices that are both critical to set correctly and difficult for the non-specialist to choose. Here, we show how to automatically configure a planner for informative path planning by training a reinforcement learning agent to select planner parameters at each iteration of informative path planning. We demonstrate our method with 37 instances of 3 distinct environments, and compare it against pure (end-to-end) reinforcement learning techniques, as well as approaches that do not use a learned model to change the planner parameters. Our method shows a 9.53 improvement in the cumulative reward across diverse environments when compared to end-to-end learning based methods; we also demonstrate via a field experiment how it can be readily used to facilitate high performance deployment of an information gathering robot.

READ FULL TEXT

page 1

page 7

research
06/02/2023

Multi-Robot Path Planning Combining Heuristics and Multi-Agent Reinforcement Learning

Multi-robot path finding in dynamic environments is a highly challenging...
research
08/14/2021

Adaptive Selection of Informative Path Planning Strategies via Reinforcement Learning

In our previous work, we designed a systematic policy to prioritize samp...
research
03/31/2023

End-to-end deep learning-based framework for path planning and collision checking: bin picking application

Real-time and efficient path planning is critical for all robotic system...
research
01/14/2023

Deep-Reinforcement-Learning-based Path Planning for Industrial Robots using Distance Sensors as Observation

Industrial robots are widely used in various manufacturing environments ...
research
09/28/2021

Adaptive Informative Path Planning Using Deep Reinforcement Learning for UAV-based Active Sensing

Aerial robots are increasingly being utilized for a wide range of enviro...
research
09/30/2021

Surveillance Evasion Through Bayesian Reinforcement Learning

We consider a 2D continuous path planning problem with a completely unkn...
research
08/02/2021

Optimal Solving of Constrained Path-Planning Problems with Graph Convolutional Networks and Optimized Tree Search

Learning-based methods are growing prominence for planning purposes. How...

Please sign up or login with your details

Forgot password? Click here to reset