When to Replan? An Adaptive Replanning Strategy for Autonomous Navigation using Deep Reinforcement Learning

04/24/2023
by   Kohei Honda, et al.
0

The hierarchy of global and local planners is one of the most commonly utilized system designs in robot autonomous navigation. While the global planner generates a reference path from the current to goal locations based on the pre-built static map, the local planner produces a collision-free, kinodynamic trajectory to follow the reference path while avoiding perceived obstacles. The reference path should be replanned regularly to accommodate new obstacles that were absent in the pre-built map, but when to execute replanning remains an open question. In this work, we conduct an extensive simulation experiment to compare various replanning strategies and confirm that effective strategies highly depend on the environment as well as on the global and local planners. We then propose a new adaptive replanning strategy based on deep reinforcement learning, where an agent learns from experiences to decide appropriate replanning timings in the given environment and planning setups. Our experimental results demonstrate that the proposed replanning agent can achieve performance on par or even better than current best-performing strategies across multiple situations in terms of navigation robustness and efficiency.

READ FULL TEXT

page 1

page 6

research
03/12/2021

Goal-Driven Autonomous Mapping Through Deep Reinforcement Learning and Planning-Based Navigation

In this paper, we present a goal-driven autonomous mapping and explorati...
research
11/16/2021

Learning to Navigate in a VUCA Environment: Hierarchical Multi-expert Approach

Despite decades of efforts, robot navigation in a real scenario with vol...
research
02/22/2021

Autonomous Obstacle Avoidance by Learning Policies for Reference Modification

The key problem for autonomous robots is how to navigate through complex...
research
03/18/2021

From Navigation to Racing: Reward Signal Design for Autonomous Racing

The problem of autonomous navigation is to generate a set of navigation ...
research
06/27/2021

Continuous Control with Deep Reinforcement Learning for Autonomous Vessels

Maritime autonomous transportation has played a crucial role in the glob...
research
02/02/2020

Integrating Deep Reinforcement Learning with Model-based Path Planners for Automated Driving

Automated driving in urban settings is challenging chiefly due to the in...
research
03/23/2020

Using Deep Reinforcement Learning Methods for Autonomous Vessels in 2D Environments

Unmanned Surface Vehicles technology (USVs) is an exciting topic that es...

Please sign up or login with your details

Forgot password? Click here to reset