DeepAI AI Chat
Log In Sign Up

Deep reinforcement learning oriented for real world dynamic scenarios

by   Diego Martinez, et al.
University of Zaragoza

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots. Recent deep reinforcement learning approaches show promising results to solve the problem, but it is not solved yet, as they typically assume no robot kinodynamic restrictions, holonomic movement or perfect environment knowledge. Moreover, most algorithms fail in the real world due to the inability to generate real-world training data for the huge variability of possible scenarios. In this work, we present a novel planner, DQN-DOVS, that uses deep reinforcement learning on a descriptive robocentric velocity space model to navigate in highly dynamic environments. It is trained using a smart curriculum learning approach on a simulator that faithfully reproduces the real world, reducing the gap between the reality and simulation. We test the resulting algorithm in scenarios with different number of obstacles and compare it with many state-of-the-art approaches, obtaining a better performance. Finally, we try the algorithm in a ground robot, using the same setup as in the simulation experiments.


page 1

page 5


From Simulation to Real World Maneuver Execution using Deep Reinforcement Learning

Deep Reinforcement Learning has proved to be able to solve many control ...

A Deep Reinforcement Learning Strategy for UAV Autonomous Landing on a Platform

With the development of industry, drones are appearing in various field....

Analysing Deep Reinforcement Learning Agents Trained with Domain Randomisation

Deep reinforcement learning has the potential to train robots to perform...

Dynamic Routing for Navigation in Changing Unknown Maps Using Deep Reinforcement Learning

In this work, we propose an approach for an autonomous agent that learns...

Local Navigation Among Movable Obstacles with Deep Reinforcement Learning

Autonomous robots would benefit a lot by gaining the ability to manipula...

Deep Inventory Management

We present a Deep Reinforcement Learning approach to solving a periodic ...

Deep Reinforcement Learning for Localizability-Enhanced Navigation in Dynamic Human Environments

Reliable localization is crucial for autonomous robots to navigate effic...