A comparative evaluation of machine learning methods for robot navigation through human crowds

by   Anastasia Gaydashenko, et al.

Robot navigation through crowds poses a difficult challenge to AI systems, since the methods should result in fast and efficient movement but at the same time are not allowed to compromise safety. Most approaches to date were focused on the combination of pathfinding algorithms with machine learning for pedestrian walking prediction. More recently, reinforcement learning techniques have been proposed in the research literature. In this paper, we perform a comparative evaluation of pathfinding/prediction and reinforcement learning approaches on a crowd movement dataset collected from surveillance videos taken at Grand Central Station in New York. The results demonstrate the strong superiority of state-of-the-art reinforcement learning approaches over pathfinding with state-of-the-art behaviour prediction techniques.


page 2

page 3

page 4


Comparative Analysis of Human Movement Prediction: Space Syntax and Inverse Reinforcement Learning

Space syntax matrix has been the main approach for human movement predic...

NavRep: Unsupervised Representations for Reinforcement Learning of Robot Navigation in Dynamic Human Environments

Robot navigation is a task where reinforcement learning approaches are s...

Reinforcement Learning Approaches in Social Robotics

There is a growing body of literature that formulates social human-robot...

Control of a Nature-inspired Scorpion using Reinforcement Learning

A terrestrial robot that can maneuver rough terrain and scout places is ...

Human-Aware Robot Navigation via Reinforcement Learning with Hindsight Experience Replay and Curriculum Learning

In recent years, the growing demand for more intelligent service robots ...

Active Reinforcement Learning – A Roadmap Towards Curious Classifier Systems for Self-Adaptation

Intelligent systems have the ability to improve their behaviour over tim...

Detecting danger in gridworlds using Gromov's Link Condition

Gridworlds have been long-utilised in AI research, particularly in reinf...