Context-Aware Streaming Perception in Dynamic Environments

08/16/2022
by   Gur-Eyal Sela, et al.
7

Efficient vision works maximize accuracy under a latency budget. These works evaluate accuracy offline, one image at a time. However, real-time vision applications like autonomous driving operate in streaming settings, where ground truth changes between inference start and finish. This results in a significant accuracy drop. Therefore, a recent work proposed to maximize accuracy in streaming settings on average. In this paper, we propose to maximize streaming accuracy for every environment context. We posit that scenario difficulty influences the initial (offline) accuracy difference, while obstacle displacement in the scene affects the subsequent accuracy degradation. Our method, Octopus, uses these scenario properties to select configurations that maximize streaming accuracy at test time. Our method improves tracking performance (S-MOTA) by 7.4 performance improvement using our method comes in addition to, and not instead of, advances in offline accuracy.

READ FULL TEXT

page 12

page 21

research
03/23/2022

Real-time Object Detection for Streaming Perception

Autonomous driving requires the model to perceive the environment and (r...
research
07/30/2021

Real-time Streaming Perception System for Autonomous Driving

Nowadays, plenty of deep learning technologies are being applied to all ...
research
12/17/2022

Are We Ready for Vision-Centric Driving Streaming Perception? The ASAP Benchmark

In recent years, vision-centric perception has flourished in various aut...
research
12/22/2022

DaDe: Delay-adaptive Detector for Streaming Perception

Recognizing the surrounding environment at low latency is critical in au...
research
05/21/2020

Towards Streaming Image Understanding

Embodied perception refers to the ability of an autonomous agent to perc...
research
06/10/2021

Adaptive Streaming Perception using Deep Reinforcement Learning

Executing computer vision models on streaming visual data, or streaming ...
research
10/18/2019

Implicit Context-aware Learning and Discovery for Streaming Data Analytics

The performance of machine learning model can be further improved if con...

Please sign up or login with your details

Forgot password? Click here to reset