DeepAI AI Chat
Log In Sign Up

SCENE: Reasoning about Traffic Scenes using Heterogeneous Graph Neural Networks

by   Thomas Monninger, et al.

Understanding traffic scenes requires considering heterogeneous information about dynamic agents and the static infrastructure. In this work we propose SCENE, a methodology to encode diverse traffic scenes in heterogeneous graphs and to reason about these graphs using a heterogeneous Graph Neural Network encoder and task-specific decoders. The heterogeneous graphs, whose structures are defined by an ontology, consist of different nodes with type-specific node features and different relations with type-specific edge features. In order to exploit all the information given by these graphs, we propose to use cascaded layers of graph convolution. The result is an encoding of the scene. Task-specific decoders can be applied to predict desired attributes of the scene. Extensive evaluation on two diverse binary node classification tasks show the main strength of this methodology: despite being generic, it even manages to outperform task-specific baselines. The further application of our methodology to the task of node classification in various knowledge graphs shows its transferability to other domains.


Meta Graph Attention on Heterogeneous Graph with Node-Edge Co-evolution

Graph neural networks have become an important tool for modeling structu...

Relation-based Motion Prediction using Traffic Scene Graphs

Representing relevant information of a traffic scene and understanding i...

GSim: A Graph Neural Network based Relevance Measure for Heterogeneous Graphs

Heterogeneous graphs, which contain nodes and edges of multiple types, a...

SGAT: Simplicial Graph Attention Network

Heterogeneous graphs have multiple node and edge types and are semantica...

Efficient Automatic Machine Learning via Design Graphs

Despite the success of automated machine learning (AutoML), which aims t...

Task-specific Scene Structure Representations

Understanding the informative structures of scenes is essential for low-...

SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences

Scene graphs are a compact and explicit representation successfully used...