Attention-based Neural Network for Driving Environment Complexity Perception

06/21/2021
by   Ce Zhang, et al.
0

Environment perception is crucial for autonomous vehicle (AV) safety. Most existing AV perception algorithms have not studied the surrounding environment complexity and failed to include the environment complexity parameter. This paper proposes a novel attention-based neural network model to predict the complexity level of the surrounding driving environment. The proposed model takes naturalistic driving videos and corresponding vehicle dynamics parameters as input. It consists of a Yolo-v3 object detection algorithm, a heat map generation algorithm, CNN-based feature extractors, and attention-based feature extractors for both video and time-series vehicle dynamics data inputs to extract features. The output from the proposed algorithm is a surrounding environment complexity parameter. The Berkeley DeepDrive dataset (BDD Dataset) and subjectively labeled surrounding environment complexity levels are used for model training and validation to evaluate the algorithm. The proposed attention-based network achieves 91.22 classify the surrounding environment complexity. It proves that the environment complexity level can be accurately predicted and applied for future AVs' environment perception studies.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
02/24/2020

See, Attend and Brake: An Attention-based Saliency Map Prediction Model for End-to-End Driving

Visual perception is the most critical input for driving decisions. In t...
research
08/06/2019

Co-Attention Based Neural Network for Source-Dependent Essay Scoring

This paper presents an investigation of using a co-attention based neura...
research
09/22/2021

Early Lane Change Prediction for Automated Driving Systems Using Multi-Task Attention-based Convolutional Neural Networks

Lane change (LC) is one of the safety-critical manoeuvres in highway dri...
research
07/31/2023

Multi Agent Navigation in Unconstrained Environments using a Centralized Attention based Graphical Neural Network Controller

In this work, we propose a learning based neural model that provides bot...
research
03/01/2021

Panoramic Panoptic Segmentation: Towards Complete Surrounding Understanding via Unsupervised Contrastive Learning

In this work, we introduce panoramic panoptic segmentation as the most h...
research
12/02/2021

Situation-Aware Environment Perception Using a Multi-Layer Attention Map

Within the field of automated driving, a clear trend in environment perc...
research
09/09/2022

Improving the Environmental Perception of Autonomous Vehicles using Deep Learning-based Audio Classification

Sense of hearing is crucial for autonomous vehicles (AVs) to better perc...

Please sign up or login with your details

Forgot password? Click here to reset