Project Aria: A New Tool for Egocentric Multi-Modal AI Research

08/24/2023
by   Kiran Somasundaram, et al.
0

Egocentric, multi-modal data as available on future augmented reality (AR) devices provides unique challenges and opportunities for machine perception. These future devices will need to be all-day wearable in a socially acceptable form-factor to support always available, context-aware and personalized AI applications. Our team at Meta Reality Labs Research built the Aria device, an egocentric, multi-modal data recording and streaming device with the goal to foster and accelerate research in this area. In this paper, we describe the Aria device hardware including its sensor configuration and the corresponding software tools that enable recording and processing of such data.

READ FULL TEXT

page 1

page 3

page 5

page 7

research
05/17/2023

Augmenting Learning with Augmented Reality: Exploring the Affordances of AR in Supporting Mastery of Complex Psychomotor Tasks

This research seeks to explore how Augmented Reality (AR) can support le...
research
11/10/2021

A Structure Feature Algorithm for Multi-modal Forearm Registration

Augmented reality technology based on image registration is becoming inc...
research
04/08/2021

Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems

Optimizing the quality of result (QoR) and the quality of service (QoS) ...
research
04/13/2023

The future of hearing aid technology

Background. Hearing aid technology has proven successful in the rehabili...
research
12/02/2022

MMBench: Benchmarking End-to-End Multi-modal DNNs and Understanding Their Hardware-Software Implications

The explosive growth of various types of big data and advances in AI tec...
research
03/29/2018

FutureMapping: The Computational Structure of Spatial AI Systems

We discuss and predict the evolution of Simultaneous Localisation and Ma...
research
07/09/2021

EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environments

Augmented Reality (AR) as a platform has the potential to facilitate the...

Please sign up or login with your details

Forgot password? Click here to reset