WebAssembly enables low latency interoperable augmented and virtual reality software

10/14/2021
by   Bohdan B. Khomtchouk, et al.
0

There is a clear difference in runtime performance between native applications that use augmented/virtual reality (AR/VR) device-specific hardware and comparable web-based implementations. Here we show that WebAssembly (Wasm) offers a promising developer solution that can bring near-native low latency performance to web-based applications, enabling hardware-agnostic interoperability at scale through portable bytecode that runs on any WiFi or cellular data network-enabled AR/VR device. Many software application areas have begun to realize Wasm's potential as a key enabling technology, but it has yet to establish a robust presence in the AR/VR domain. When considering the limitations of current web-based AR/VR development technologies such as WebXR, which provides an existing application programming interface (API) that enables AR/VR capabilities for web-based programs, Wasm can resolve critical issues faced with just-in-time (JIT) compilation, slow run-times, large file sizes and big data, among other challenges. Existing applications using Wasm-based WebXR are sparse but growing, and the potential for porting native applications to use this emerging framework will benefit the web-based AR/VR application space and bring it closer to its native counterparts in terms of performance. Taken together, this kind of standardized "write-once-deploy-everywhere" software framework for AR/VR applications has the potential to consolidate user experiences across different head-mounted displays and other compatible hardware devices to ultimately create an interoperable AR/VR ecosystem.

READ FULL TEXT
research
04/26/2023

Inclusive AR/VR: Accessibility Barriers for Immersive Technologies

Augmented and virtual reality (AR/VR) hold significant potential to tran...
research
04/24/2023

Instant-3D: Instant Neural Radiance Field Training Towards On-Device AR/VR 3D Reconstruction

Neural Radiance Field (NeRF) based 3D reconstruction is highly desirable...
research
10/31/2017

Multi-Path Cooperative Communications Networks for Augmented and Virtual Reality Transmission

Augmented and/or virtual reality (AR/VR) are emerging as one of the main...
research
06/05/2019

Nail Polish Try-On: Realtime Semantic Segmentation of Small Objects for Native and Browser Smartphone AR Applications

We provide a system for semantic segmentation of small objects that enab...
research
01/08/2021

Adaptive Accessible AR/VR Systems

Augmented, virtual and mixed reality technologies offer new ways of inte...
research
03/14/2022

Distributed On-Sensor Compute System for AR/VR Devices: A Semi-Analytical Simulation Framework for Power Estimation

Augmented Reality/Virtual Reality (AR/VR) glasses are widely foreseen as...
research
04/24/2023

Auto-CARD: Efficient and Robust Codec Avatar Driving for Real-time Mobile Telepresence

Real-time and robust photorealistic avatars for telepresence in AR/VR ha...

Please sign up or login with your details

Forgot password? Click here to reset