Spatio-Temporal Scene-Graph Embedding for Autonomous Vehicle Collision Prediction

11/11/2021
by   Arnav V. Malawade, et al.
25

In autonomous vehicles (AVs), early warning systems rely on collision prediction to ensure occupant safety. However, state-of-the-art methods using deep convolutional networks either fail at modeling collisions or are too expensive/slow, making them less suitable for deployment on AV edge hardware. To address these limitations, we propose sg2vec, a spatio-temporal scene-graph embedding methodology that uses Graph Neural Network (GNN) and Long Short-Term Memory (LSTM) layers to predict future collisions via visual scene perception. We demonstrate that sg2vec predicts collisions 8.11 earlier than the state-of-the-art method on synthesized datasets, and 29.47 more accurately on a challenging real-world collision dataset. We also show that sg2vec is better than the state-of-the-art at transferring knowledge from synthetic datasets to real-world driving datasets. Finally, we demonstrate that sg2vec performs inference 9.3x faster with an 88.0 power, and 92.8 industry-standard Nvidia DRIVE PX 2 platform, making it more suitable for implementation on the edge.

READ FULL TEXT

page 2

page 4

page 6

page 8

page 9

research
11/15/2021

Short-Term Power Prediction for Renewable Energy Using Hybrid Graph Convolutional Network and Long Short-Term Memory Approach

Accurate short-term solar and wind power predictions play an important r...
research
06/22/2022

S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Driving

To safely and rationally participate in dense and heterogeneous traffic,...
research
11/05/2021

DriveGuard: Robustification of Automated Driving Systems with Deep Spatio-Temporal Convolutional Autoencoder

Autonomous vehicles increasingly rely on cameras to provide the input fo...
research
09/29/2019

Lane Attention: Predicting Vehicles' Moving Trajectories by Learning Their Attention over Lanes

Accurately forecasting the future movements of surrounding vehicles is e...
research
06/08/2021

Safe Deep Q-Network for Autonomous Vehicles at Unsignalized Intersection

We propose a safe DRL approach for autonomous vehicle (AV) navigation th...
research
09/02/2021

roadscene2vec: A Tool for Extracting and Embedding Road Scene-Graphs

Recently, road scene-graph representations used in conjunction with grap...
research
04/03/2019

A Visual Neural Network for Robust Collision Perception in Vehicle Driving Scenarios

This research addresses the challenging problem of visual collision dete...

Please sign up or login with your details

Forgot password? Click here to reset