Prediction of Human Trajectory Following a Haptic Robotic Guide Using Recurrent Neural Networks

by   Hee-Seung Moon, et al.

Social intelligence is an important requirement for enabling robots to collaborate with people. In particular, human path prediction is an essential capability for robots in that it prevents potential collision with a human and allows the robot to safely make larger movements. In this paper, we present a method for predicting the trajectory of a human who follows a haptic robotic guide without using sight, which is valuable for assistive robots that aid the visually impaired. We apply a deep learning method based on recurrent neural networks using multimodal data: (1) human trajectory, (2) movement of the robotic guide, (3) haptic input data measured from the physical interaction between the human and the robot, (4) human depth data. We collected actual human trajectory and multimodal response data through indoor experiments. Our model outperformed the baseline result while using only the robot data with the observed human trajectory, and it shows even better results when using additional haptic and depth data.



page 4


Sample-Efficient Training of Robotic Guide Using Human Path Prediction Network

Training a robot that engages with people is challenging, because it is ...

Trajectory Deformations from Physical Human-Robot Interaction

Robots are finding new applications where physical interaction with a hu...

Predicting Responses to a Robot's Future Motion using Generative Recurrent Neural Networks

Robotic navigation through crowds or herds requires the ability to both ...

Human-Robot Shared Control for Surgical Robot Based on Context-Aware Sim-to-Real Adaptation

Human-robot shared control, which integrates the advantages of both huma...

Emotive Response to a Hybrid-Face Robot and Translation to Consumer Social Robots

We introduce the conceptual formulation, design, fabrication, control an...

Robotic Guide Dog: Leading a Human with Leash-Guided Hybrid Physical Interaction

An autonomous robot that is able to physically guide humans through narr...

Object Permanence Through Audio-Visual Representations

As robots perform manipulation tasks and interact with objects, it is pr...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.