Understanding Time Variations of DNN Inference in Autonomous Driving

09/12/2022
by   Liangkai Liu, et al.
0

Deep neural networks (DNNs) are widely used in autonomous driving due to their high accuracy for perception, decision, and control. In safety-critical systems like autonomous driving, executing tasks like sensing and perception in real-time is vital to the vehicle's safety, which requires the application's execution time to be predictable. However, non-negligible time variations are observed in DNN inference. Current DNN inference studies either ignore the time variation issue or rely on the scheduler to handle it. None of the current work explains the root causes of DNN inference time variations. Understanding the time variations of the DNN inference becomes a fundamental challenge in real-time scheduling for autonomous driving. In this work, we analyze the time variation in DNN inference in fine granularity from six perspectives: data, I/O, model, runtime, hardware, and end-to-end perception system. Six insights are derived in understanding the time variations for DNN inference.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/16/2021

Adversarial Driving: Attacking End-to-End Autonomous Driving Systems

As the research in deep neural networks advances, deep convolutional net...
research
10/10/2019

Misbehaviour Prediction for Autonomous Driving Systems

Deep Neural Networks (DNNs) are the core component of modern autonomous ...
research
11/18/2021

DeepGuard: A Framework for Safeguarding Autonomous Driving Systems from Inconsistent Behavior

The deep neural networks (DNNs)based autonomous driving systems (ADSs) a...
research
05/29/2020

Reducing DNN Labelling Cost using Surprise Adequacy: An Industrial Case Study for Autonomous Driving

Deep Neural Networks (DNNs) are rapidly being adopted by the automotive ...
research
11/18/2019

NAIS: Neural Architecture and Implementation Search and its Applications in Autonomous Driving

The rapidly growing demands for powerful AI algorithms in many applicati...
research
02/06/2023

Closed-loop Analysis of Vision-based Autonomous Systems: A Case Study

Deep neural networks (DNNs) are increasingly used in safety-critical aut...
research
10/12/2020

Continuous Safety Verification of Neural Networks

Deploying deep neural networks (DNNs) as core functions in autonomous dr...

Please sign up or login with your details

Forgot password? Click here to reset