DeepAI AI Chat
Log In Sign Up

CloudAR: A Cloud-based Framework for Mobile Augmented Reality

05/08/2018
by   Wenxiao Zhang, et al.
The Hong Kong University of Science and Technology
0

Computation capabilities of recent mobile devices enable natural feature processing for Augmented Reality (AR). However, mobile AR applications are still faced with scalability and performance challenges. In this paper, we propose CloudAR, a mobile AR framework utilizing the advantages of cloud and edge computing through recognition task offloading. We explore the design space of cloud-based AR exhaustively and optimize the offloading pipeline to minimize the time and energy consumption. We design an innovative tracking system for mobile devices which provides lightweight tracking in 6 degree of freedom (6DoF) and hides the offloading latency from users' perception. We also design a multi-object image retrieval pipeline that executes fast and accurate image recognition tasks on servers. In our evaluations, the mobile AR application built with the CloudAR framework runs at 30 frames per second (FPS) on average with precise tracking of only 1 2 pixel errors and image recognition of at least 97 leading commercial AR framework in several performance metrics.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

page 9

page 13

11/09/2021

EdgeXAR: A 6-DoF Camera Multi-target Interaction Framework for MAR with User-friendly Latency Compensation

The computational capabilities of recent mobile devices enable the proce...
10/05/2018

An Edge-Computing Based Architecture for Mobile Augmented Reality

In order to mitigate the long processing delay and high energy consumpti...
06/06/2023

Real-Time Onboard Object Detection for Augmented Reality: Enhancing Head-Mounted Display with YOLOv8

This paper introduces a software architecture for real-time object detec...
12/21/2019

The Mobile AR Sensor Logger for Android and iOS Devices

In recent years, commodity mobile devices equipped with cameras and iner...
02/11/2022

Improving Image-recognition Edge Caches with a Generative Adversarial Network

Image recognition is an essential task in several mobile applications. F...
07/12/2018

Immersion on the Edge: A Cooperative Framework for Mobile Immersive Computing

Immersive computing (IC) technologies such as virtual reality and augmen...