Self-Configurable Stabilized Real-Time Detection Learning for Autonomous Driving Applications

09/29/2022
by   Won Joon Yun, et al.
0

Guaranteeing real-time and accurate object detection simultaneously is paramount in autonomous driving environments. However, the existing object detection neural network systems are characterized by a tradeoff between computation time and accuracy, making it essential to optimize such a tradeoff. Fortunately, in many autonomous driving environments, images come in a continuous form, providing an opportunity to use optical flow. In this paper, we improve the performance of an object detection neural network utilizing optical flow estimation. In addition, we propose a Lyapunov optimization framework for time-average performance maximization subject to stability. It adaptively determines whether to use optical flow to suit the dynamic vehicle environment, thereby ensuring the vehicle's queue stability and the time-average maximum performance simultaneously. To verify the key ideas, we conduct numerical experiments with various object detection neural networks and optical flow estimation networks. In addition, we demonstrate the self-configurable stabilized detection with YOLOv3-tiny and FlowNet2-S, which are the real-time object detection network and an optical flow estimation network, respectively. In the demonstration, our proposed framework improves the accuracy by 3.02 stability for computing capabilities.

READ FULL TEXT

page 1

page 2

research
01/11/2023

Optical Flow for Autonomous Driving: Applications, Challenges and Improvements

Optical flow estimation is a well-studied topic for automated driving ap...
research
03/10/2023

SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Driving

Unsupervised optical flow estimation is especially hard near occlusions ...
research
05/22/2018

A Convolutional Feature Map based Deep Network targeted towards Traffic Detection and Classification

This research mainly emphasizes on traffic detection thus essentially in...
research
02/02/2022

CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving

Optical flow estimation is an essential task in self-driving systems, wh...
research
07/29/2023

Freespace Optical Flow Modeling for Automated Driving

Optical flow and disparity are two informative visual features for auton...
research
08/15/2019

Bypass Enhancement RGB Stream Model for Pedestrian Action Recognition of Autonomous Vehicles

Pedestrian action recognition and intention prediction are one of the co...
research
10/20/2021

Detecting and Identifying Optical Signal Attacks on Autonomous Driving Systems

For autonomous driving, an essential task is to detect surrounding objec...

Please sign up or login with your details

Forgot password? Click here to reset