MultiScope: Efficient Video Pre-processing for Exploratory Video Analytics

03/26/2021
by   Favyen Bastani, et al.
0

Performing analytics tasks over large-scale video datasets is increasingly common in a wide range of applications. These tasks generally involve object detection and tracking operations that require applying expensive machine learning models, and several systems have recently been proposed to optimize the execution of video queries to reduce their cost. However, prior work generally optimizes execution speed in only one dimension, focusing on one optimization technique while ignoring other potential avenues for accelerating execution, thereby delivering an unsatisfactory tradeoff between speed and accuracy. We propose MultiScope, a general-purpose video pre-processor for object detection and tracking that explores multiple avenues for optimizing video queries to extract tracks from video with a superior tradeoff between speed and accuracy over prior work. We compare MultiScope against three recent systems on seven diverse datasets, and find that it provides a 2.9x average speedup over the next best baseline at the same accuracy level.

READ FULL TEXT

page 4

page 7

research
11/30/2017

Towards High Performance Video Object Detection

There has been significant progresses for image object detection in rece...
research
05/02/2018

BlazeIt: Fast Exploratory Video Queries using Neural Networks

As video volumes grow, analysts have increasingly turned to deep learnin...
research
11/17/2020

Optimizing Graph Processing and Preprocessing with Hardware Assisted Propagation Blocking

Extensive prior research has focused on alleviating the characteristic p...
research
04/30/2018

MV-YOLO: Motion Vector-aided Tracking by Semantic Object Detection

Object tracking is the cornerstone of many visual analytics systems. Whi...
research
02/08/2019

AdaScale: Towards Real-time Video Object Detection Using Adaptive Scaling

In vision-enabled autonomous systems such as robots and autonomous cars,...
research
04/16/2018

Optimizing Video Object Detection via a Scale-Time Lattice

High-performance object detection relies on expensive convolutional netw...
research
02/16/2021

THIA: Accelerating Video Analytics using Early Inference and Fine-Grained Query Planning

To efficiently process visual data at scale, researchers have proposed t...

Please sign up or login with your details

Forgot password? Click here to reset