Towards Explainable Motion Prediction using Heterogeneous Graph Representations

12/07/2022
by   Sandra Carrasco Limeros, et al.
0

Motion prediction systems aim to capture the future behavior of traffic scenarios enabling autonomous vehicles to perform safe and efficient planning. The evolution of these scenarios is highly uncertain and depends on the interactions of agents with static and dynamic objects in the scene. GNN-based approaches have recently gained attention as they are well suited to naturally model these interactions. However, one of the main challenges that remains unexplored is how to address the complexity and opacity of these models in order to deal with the transparency requirements for autonomous driving systems, which includes aspects such as interpretability and explainability. In this work, we aim to improve the explainability of motion prediction systems by using different approaches. First, we propose a new Explainable Heterogeneous Graph-based Policy (XHGP) model based on an heterograph representation of the traffic scene and lane-graph traversals, which learns interaction behaviors using object-level and type-level attention. This learned attention provides information about the most important agents and interactions in the scene. Second, we explore this same idea with the explanations provided by GNNExplainer. Third, we apply counterfactual reasoning to provide explanations of selected individual scenarios by exploring the sensitivity of the trained model to changes made to the input data, i.e., masking some elements of the scene, modifying trajectories, and adding or removing dynamic agents. The explainability analysis provided in this paper is a first step towards more transparent and reliable motion prediction systems, important from the perspective of the user, developers and regulatory agencies. The code to reproduce this work is publicly available at https://github.com/sancarlim/Explainable-MP/tree/v1.1.

READ FULL TEXT

page 2

page 9

page 10

page 11

page 13

page 14

research
09/27/2020

Interaction-Based Trajectory Prediction Over a Hybrid Traffic Graph

Behavior prediction of traffic actors is an essential component of any r...
research
02/23/2021

Grounded Relational Inference: Domain Knowledge Driven Explainable Autonomous Driving

Explainability is essential for autonomous vehicles and other robotics s...
research
02/07/2023

Explainable Action Prediction through Self-Supervision on Scene Graphs

This work explores scene graphs as a distilled representation of high-le...
research
09/07/2023

InteractionNet: Joint Planning and Prediction for Autonomous Driving with Transformers

Planning and prediction are two important modules of autonomous driving ...
research
05/08/2020

Attentional Bottleneck: Towards an Interpretable Deep Driving Network

Deep neural networks are a key component of behavior prediction and moti...
research
03/08/2023

Dynamic Scenario Representation Learning for Motion Forecasting with Heterogeneous Graph Convolutional Recurrent Networks

Due to the complex and changing interactions in dynamic scenarios, motio...
research
07/12/2022

Wayformer: Motion Forecasting via Simple Efficient Attention Networks

Motion forecasting for autonomous driving is a challenging task because ...

Please sign up or login with your details

Forgot password? Click here to reset