Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning

05/04/2018
by   Michael Everett, et al.
2

Robots that navigate among pedestrians use collision avoidance algorithms to enable safe and efficient operation. Recent works present deep reinforcement learning as a framework to model the complex interactions and cooperation. However, they are implemented using key assumptions about other agents' behavior that deviate from reality as the number of agents in the environment increases. This work extends our previous approach to develop an algorithm that learns collision avoidance among a variety of types of dynamic agents without assuming they follow any particular behavior rules. This work also introduces a strategy using LSTM that enables the algorithm to use observations of an arbitrary number of other agents, instead of previous methods that have a fixed observation size. The proposed algorithm outperforms our previous approach in simulation as the number of agents increases, and the algorithm is demonstrated on a fully autonomous robotic vehicle traveling at human walking speed, without the use of a 3D Lidar.

READ FULL TEXT

page 1

page 6

page 8

research
10/24/2019

Collision Avoidance in Pedestrian-Rich Environments with Deep Reinforcement Learning

Collision avoidance algorithms are essential for safe and efficient robo...
research
01/15/2020

CIAO^: MPC-based Safe Motion Planning in Predictable Dynamic Environments

Robots have been operating in dynamic environments and shared workspaces...
research
06/17/2020

Deep Reinforcement Learning Controller for 3D Path-following and Collision Avoidance by Autonomous Underwater Vehicles

Control theory provides engineers with a multitude of tools to design co...
research
06/15/2023

Inroads into Autonomous Network Defence using Explained Reinforcement Learning

Computer network defence is a complicated task that has necessitated a h...
research
06/04/2018

Adversarial Reinforcement Learning Framework for Benchmarking Collision Avoidance Mechanisms in Autonomous Vehicles

With the rapidly growing interest in autonomous navigation, the body of ...
research
10/14/2019

On the Effects of Collision Avoidance on Emergent Swarm Behavior

Swarms of autonomous agents, through their decentralized and robust natu...
research
10/19/2018

Safe Reinforcement Learning with Model Uncertainty Estimates

Many current autonomous systems are being designed with a strong relianc...

Please sign up or login with your details

Forgot password? Click here to reset