DeepAI AI Chat
Log In Sign Up

Bio-LSTM: A Biomechanically Inspired Recurrent Neural Network for 3D Pedestrian Pose and Gait Prediction

by   Xiaoxiao Du, et al.

In applications such as autonomous driving, it is important to understand, infer, and anticipate the intention and future behavior of pedestrians. This ability allows vehicles to avoid collisions and improve ride safety and quality. This paper proposes a biomechanically inspired recurrent neural network (Bio-LSTM) that can predict the location and 3D articulated body pose of pedestrians in a global coordinate frame, given 3D poses and locations estimated in prior frames with inaccuracy. The proposed network is able to predict poses and global locations for multiple pedestrians simultaneously, for pedestrians up to 45 meters from the cameras (urban intersection scale). The outputs of the proposed network are full-body 3D meshes represented in Skinned Multi-Person Linear (SMPL) model parameters. The proposed approach relies on a novel objective function that incorporates the periodicity of human walking (gait), the mirror symmetry of the human body, and the change of ground reaction forces in a human gait cycle. This paper presents prediction results on the PedX dataset, a large-scale, in-the-wild data set collected at real urban intersections with heavy pedestrian traffic. Results show that the proposed network can successfully learn the characteristics of pedestrian gait and produce accurate and consistent 3D pose predictions.


page 1

page 2

page 3

page 4


Autonomous Driving among Many Pedestrians: Models and Algorithms

Driving among a dense crowd of pedestrians is a major challenge for auto...

Fast Estimating Pedestrian Moving State Based on Single 2D Body Pose by Shallow Neural Network

Crossing or Not-Crossing (C/NC) problem is important to autonomous vehic...

Utility Decomposition with Deep Corrections for Scalable Planning under Uncertainty

Decomposition methods have been proposed in the past to approximate solu...

Pedestrian Motion State Estimation From 2D Pose

Traffic violation and the flexible and changeable nature of pedestrians ...

Pedestrian Behavior Prediction for Automated Driving: Requirements, Metrics, and Relevant Features

Automated vehicles require a comprehensive understanding of traffic situ...

PedX: Benchmark Dataset for Metric 3D Pose Estimation of Pedestrians in Complex Urban Intersections

This paper presents a novel dataset titled PedX, a large-scale multimoda...