Fast Estimating Pedestrian Moving State Based on Single 2D Body Pose by Shallow Neural Network

07/09/2019
by   Zixing Wang, et al.
7

Crossing or Not-Crossing (C/NC) problem is important to autonomous vehicles (AVs) to safely interact with pedestrians. However, this problem setup ignores pedestrians walking along the direction of vehicles' movement (LONG). To enhance AVs' awareness of pedestrians behavior, we make the first step towards extending C/NC to C/NC/LONG problem and recognize them based on single body pose. In contrast, previous C/NC state classification work depend on multiple poses or contextual information. Our proposed shallow neural network classifier is able to recognize these three states within a very short time. We test our it on JAAD dataset and report average 81.23 improve the classifier's performance, we introduce a computational-efficient method, action momentum optimizer (AMO), which correct prediction based on crossing behavior pattern. And our experiment shows that classifier perform at most 11.39 this model can cooperate with different sensors and algorithms that provide 2D pedestrian body pose so that it is able to work across multiple light and weather conditions. In addition, we have created extended annotations of pose for JAAD dataset, which will be publicly released soon

READ FULL TEXT

page 1

page 2

page 3

page 7

page 8

research
03/27/2023

Pedestrian Behavior Interacting with Autonomous Vehicles: Role of AV Operation and Signal Indication and Roadway Infrastructure

Interacting with pedestrians is challenging for Autonomous vehicles (AVs...
research
09/11/2018

Bio-LSTM: A Biomechanically Inspired Recurrent Neural Network for 3D Pedestrian Pose and Gait Prediction

In applications such as autonomous driving, it is important to understan...
research
03/22/2020

Efficient Behavior-aware Control of Automated Vehicles at Crosswalks using Minimal Information Pedestrian Prediction Model

For automated vehicles (AVs) to reliably navigate through crosswalks, th...
research
10/09/2019

Intention Recognition of Pedestrians and Cyclists by 2D Pose Estimation

Anticipating the intentions of vulnerable road users (VRUs) such as pede...
research
01/06/2021

Single Shot Multitask Pedestrian Detection and Behavior Prediction

Detecting and predicting the behavior of pedestrians is extremely crucia...
research
05/25/2022

From Pedestrian Detection to Crosswalk Estimation: An EM Algorithm and Analysis on Diverse Datasets

In this work, we contribute an EM algorithm for estimation of corner poi...

Please sign up or login with your details

Forgot password? Click here to reset