Robot Navigation in Crowds by Graph Convolutional Networks with Attention Learned from Human Gaze

09/23/2019
by   Yuying Chen, et al.
0

Safe and efficient crowd navigation for mobile robot is a crucial yet challenging task. Previous work has shown the power of deep reinforcement learning frameworks to train efficient policies. However, their performance deteriorates when the crowd size grows. We suggest that this can be addressed by enabling the network to identify and pay attention to the humans in the crowd that are most critical to navigation. We propose a novel network utilizing a graph representation to learn the policy. We first train a graph convolutional network based on human gaze data that accurately predicts human attention to different agents in the crowd. Then we incorporate the learned attention into a graph-based reinforcement learning architecture. The proposed attention mechanism enables the assignment of meaningful weightings to the neighbors of the robot, and has the additional benefit of interpretability. Experiments on real-world dense pedestrian datasets with various crowd sizes demonstrate that our model outperforms state-of-art methods by 18.4 accomplishment and by 16.4

READ FULL TEXT
research
01/14/2021

AVGCN: Trajectory Prediction using Graph Convolutional Networks Guided by Human Attention

Pedestrian trajectory prediction is a critical yet challenging task, esp...
research
11/09/2020

Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learning

Safe and efficient navigation through human crowds is an essential capab...
research
09/24/2018

Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learning

Mobility in an effective and socially-compliant manner is an essential y...
research
09/28/2019

Relational Graph Learning for Crowd Navigation

We present a relational graph learning approach for robotic crowd naviga...
research
02/26/2021

Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planning

It is still an open and challenging problem for mobile robots navigating...
research
05/04/2022

Multi-subgoal Robot Navigation in Crowds with History Information and Interactions

Robot navigation in dynamic environments shared with humans is an import...
research
03/03/2022

Socially Aware Robot Crowd Navigation with Interaction Graphs and Human Trajectory Prediction

We study the problem of safe and socially aware robot navigation in dens...

Please sign up or login with your details

Forgot password? Click here to reset