Intention Recognition of Pedestrians and Cyclists by 2D Pose Estimation

10/09/2019
by   Zhijie Fang, et al.
8

Anticipating the intentions of vulnerable road users (VRUs) such as pedestrians and cyclists is critical for performing safe and comfortable driving maneuvers. This is the case for human driving and, thus, should be taken into account by systems providing any level of driving assistance, from advanced driver assistant systems (ADAS) to fully autonomous vehicles (AVs). In this paper, we show how the latest advances on monocular vision-based human pose estimation, i.e. those relying on deep Convolutional Neural Networks (CNNs), enable to recognize the intentions of such VRUs. In the case of cyclists, we assume that they follow traffic rules to indicate future maneuvers with arm signals. In the case of pedestrians, no indications can be assumed. Instead, we hypothesize that the walking pattern of a pedestrian allows to determine if he/she has the intention of crossing the road in the path of the ego-vehicle, so that the ego-vehicle must maneuver accordingly (e.g. slowing down or stopping). In this paper, we show how the same methodology can be used for recognizing pedestrians and cyclists' intentions. For pedestrians, we perform experiments on the JAAD dataset. For cyclists, we did not found an analogous dataset, thus, we created our own one by acquiring and annotating videos which we share with the research community. Overall, the proposed pipeline provides new state-of-the-art results on the intention recognition of VRUs.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 9

page 10

research
10/23/2018

Action and intention recognition of pedestrians in urban traffic

Action and intention recognition of pedestrians in urban settings are ch...
research
07/15/2018

Is the Pedestrian going to Cross? Answering by 2D Pose Estimation

Our recent work suggests that, thanks to nowadays powerful CNNs, image-b...
research
09/23/2020

A Real-time Vision Framework for Pedestrian Behavior Recognition and Intention Prediction at Intersections Using 3D Pose Estimation

Minimizing traffic accidents between vehicles and pedestrians is one of ...
research
01/24/2018

When Vehicles See Pedestrians with Phones:A Multi-Cue Framework for Recognizing Phone-based Activities of Pedestrians

The intelligent vehicle community has devoted considerable efforts to mo...
research
11/28/2021

Detection of E-scooter Riders in Naturalistic Scenes

E-scooters have become ubiquitous vehicles in major cities around the wo...
research
03/15/2023

Pre-instruction for Pedestrians Interacting Autonomous Vehicles with an eHMI: Effects on Their Psychology and Walking Behavior

eHMIs refers to a novel and explicit communication method for pedestrian...
research
07/09/2019

Fast Estimating Pedestrian Moving State Based on Single 2D Body Pose by Shallow Neural Network

Crossing or Not-Crossing (C/NC) problem is important to autonomous vehic...

Please sign up or login with your details

Forgot password? Click here to reset