DaDe: Delay-adaptive Detector for Streaming Perception

12/22/2022
by   Wonwoo Jo, et al.
0

Recognizing the surrounding environment at low latency is critical in autonomous driving. In real-time environment, surrounding environment changes when processing is over. Current detection models are incapable of dealing with changes in the environment that occur after processing. Streaming perception is proposed to assess the latency and accuracy of real-time video perception. However, additional problems arise in real-world applications due to limited hardware resources, high temperatures, and other factors. In this study, we develop a model that can reflect processing delays in real time and produce the most reasonable results. By incorporating the proposed feature queue and feature select module, the system gains the ability to forecast specific time steps without any additional computational costs. Our method is tested on the Argoverse-HD dataset. It achieves higher performance than the current state-of-the-art methods(2022.12) in various environments when delayed . The code is available at https://github.com/danjos95/DADE

READ FULL TEXT

page 1

page 7

research
03/23/2022

Real-time Object Detection for Streaming Perception

Autonomous driving requires the model to perceive the environment and (r...
research
09/13/2023

MTD: Multi-Timestep Detector for Delayed Streaming Perception

Autonomous driving systems require real-time environmental perception to...
research
07/30/2021

Real-time Streaming Perception System for Autonomous Driving

Nowadays, plenty of deep learning technologies are being applied to all ...
research
05/21/2020

Towards Streaming Image Understanding

Embodied perception refers to the ability of an autonomous agent to perc...
research
08/16/2022

Context-Aware Streaming Perception in Dynamic Environments

Efficient vision works maximize accuracy under a latency budget. These w...
research
03/28/2023

System-status-aware Adaptive Network for Online Streaming Video Understanding

Recent years have witnessed great progress in deep neural networks for r...
research
05/12/2020

PSDet: Efficient and Universal Parking Slot Detection

While real-time parking slot detection plays a critical role in valet pa...

Please sign up or login with your details

Forgot password? Click here to reset