LEAF + AIO: Edge-Assisted Energy-Aware Object Detection for Mobile Augmented Reality

05/27/2022
by   Haoxin Wang, et al.
0

Today very few deep learning-based mobile augmented reality (MAR) applications are applied in mobile devices because they are significantly energy-guzzling. In this paper, we design an edge-based energy-aware MAR system that enables MAR devices to dynamically change their configurations, such as CPU frequency, computation model size, and image offloading frequency based on user preferences, camera sampling rates, and available radio resources. Our proposed dynamic MAR configuration adaptations can minimize the per frame energy consumption of multiple MAR clients without degrading their preferred MAR performance metrics, such as latency and detection accuracy. To thoroughly analyze the interactions among MAR configurations, user preferences, camera sampling rate, and energy consumption, we propose, to the best of our knowledge, the first comprehensive analytical energy model for MAR devices. Based on the proposed analytical model, we design a LEAF optimization algorithm to guide the MAR configuration adaptation and server radio resource allocation. An image offloading frequency orchestrator, coordinating with the LEAF, is developed to adaptively regulate the edge-based object detection invocations and to further improve the energy efficiency of MAR devices. Extensive evaluations are conducted to validate the performance of the proposed analytical model and algorithms.

READ FULL TEXT

page 1

page 3

page 10

page 13

page 15

research
11/26/2020

Energy Drain of the Object Detection Processing Pipeline for Mobile Devices: Analysis and Implications

Applying deep learning to object detection provides the capability to ac...
research
11/16/2022

Resource Allocation of Federated Learning for the Metaverse with Mobile Augmented Reality

The Metaverse has received much attention recently. Metaverse applicatio...
research
08/31/2023

An Energy-Aware Approach to Design Self-Adaptive AI-based Applications on the Edge

The advent of edge devices dedicated to machine learning tasks enabled t...
research
03/13/2019

Personal Dynamic Cost-Aware Sensing for Latent Context Detection

In the past decade, the usage of mobile devices has gone far beyond simp...
research
02/14/2018

Enabling Interactive Mobile Simulations Through Distributed Reduced Models

Currently, various hardware and software companies are developing augmen...
research
01/03/2023

Joint Optimization of Video-based AI Inference Tasks in MEC-assisted Augmented Reality Systems

The high computational complexity and energy consumption of artificial i...
research
05/26/2023

Digital Twin-Based 3D Map Management for Edge-Assisted Mobile Augmented Reality

In this paper, we design a 3D map management scheme for edge-assisted mo...

Please sign up or login with your details

Forgot password? Click here to reset