DeepAI AI Chat
Log In Sign Up

Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectories

by   Yanfu Zhang, et al.

Predicting the motion of a mobile agent from a third-person perspective is an important component for many robotics applications, such as autonomous navigation and tracking. With accurate motion prediction of other agents, robots can plan for more intelligent behaviors to achieve specified objectives, instead of acting in a purely reactive way. Previous work addresses motion prediction by either only filtering kinematics, or using hand-designed and learned representations of the environment. Instead of separating kinematic and environmental context, we propose a novel approach to integrate both into an inverse reinforcement learning (IRL) framework for trajectory prediction. Instead of exponentially increasing the state-space complexity with kinematics, we propose a two-stage neural network architecture that considers motion and environment together to recover the reward function. The first-stage network learns feature representations of the environment using low-level LiDAR statistics and the second-stage network combines those learned features with kinematics data. We collected over 30 km of off-road driving data and validated experimentally that our method can effectively extract useful environmental and kinematic features. We generate accurate predictions of the distribution of future trajectories of the vehicle, encoding complex behaviors such as multi-modal distributions at road intersections, and even show different predictions at the same intersection depending on the vehicle's speed.


page 2

page 5

page 6

page 7

page 8

page 11


Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Prediction

Real-time, accurate prediction of human steering behaviors has wide appl...

GET-DIPP: Graph-Embedded Transformer for Differentiable Integrated Prediction and Planning

Accurately predicting interactive road agents' future trajectories and p...

CASPNet++: Joint Multi-Agent Motion Prediction

The prediction of road users' future motion is a critical task in suppor...

Evaluation of Differentially Constrained Motion Models for Graph-Based Trajectory Prediction

Given their flexibility and encouraging performance, deep-learning model...

Topological Trajectory Prediction with Homotopy Classes

Trajectory prediction in a cluttered environment is key to many importan...