Streaming Video Analytics On The Edge With Asynchronous Cloud Support

10/04/2022
by   Anurag Ghosh, et al.
0

Emerging Internet of Things (IoT) and mobile computing applications are expected to support latency-sensitive deep neural network (DNN) workloads. To realize this vision, the Internet is evolving towards an edge-computing architecture, where computing infrastructure is located closer to the end device to help achieve low latency. However, edge computing may have limited resources compared to cloud environments and thus, cannot run large DNN models that often have high accuracy. In this work, we develop REACT, a framework that leverages cloud resources to execute large DNN models with higher accuracy to improve the accuracy of models running on edge devices. To do so, we propose a novel edge-cloud fusion algorithm that fuses edge and cloud predictions, achieving low latency and high accuracy. We extensively evaluate our approach and show that our approach can significantly improve the accuracy compared to baseline approaches. We focus specifically on object detection in videos (applicable in many video analytics scenarios) and show that the fused edge-cloud predictions can outperform the accuracy of edge-only and cloud-only scenarios by as much as 50 performance across tradeoff points by choosing a wide range of system parameters to satisfy use-case specific constraints, such as limited network bandwidth or GPU cycles.

READ FULL TEXT

page 4

page 7

page 10

page 11

research
07/15/2021

CLEDGE: A Hybrid Cloud-Edge Computing Framework over Information Centric Networking

In today's era of Internet of Things (IoT), where massive amounts of dat...
research
07/28/2019

Temporal Data Fusion at the Edge

As an enabler technique, data fusion has gained great attention in the c...
research
06/22/2023

MultiTASC: A Multi-Tenancy-Aware Scheduler for Cascaded DNN Inference at the Consumer Edge

Cascade systems comprise a two-model sequence, with a lightweight model ...
research
09/28/2020

Mez: A Messaging System for Latency-Sensitive Multi-Camera Machine Vision at the IoT Edge

Mez is a publish-subscribe messaging system for latency sensitive multi-...
research
03/22/2018

To Edge or Not to Edge?

Edge computing caters to a wide range of use cases from latency sensitiv...
research
05/10/2022

An Edge-Cloud Integrated Framework for Flexible and Dynamic Stream Analytics

With the popularity of Internet of Things (IoT), edge computing and clou...
research
02/08/2022

Edge-based fever screening system over private 5G

Edge computing and 5G have made it possible to perform analytics closer ...

Please sign up or login with your details

Forgot password? Click here to reset