MilliSonic: Pushing the Limits of Acoustic Motion Tracking

01/20/2019
by   Anran Wang, et al.
0

Recent years have seen interest in device tracking and localization using acoustic signals. State-of-the-art acoustic motion tracking systems however do not achieve millimeter accuracy and require large separation between microphones and speakers, and as a result, do not meet the requirements for many VR/AR applications. Further, tracking multiple concurrent acoustic transmissions from VR devices today requires sacrificing accuracy or frame rate. We present MilliSonic, a novel system that pushes the limits of acoustic based motion tracking. Our core contribution is a novel localization algorithm that can provably achieve sub-millimeter 1D tracking accuracy in the presence of multipath, while using only a single beacon with a small 4-microphone array.Further, MilliSonic enables concurrent tracking of up to four smartphones without reducing frame rate or accuracy. Our evaluation shows that MilliSonic achieves 0.7mm median 1D accuracy and a 2.6mm median 3D accuracy for smartphones, which is 5x more accurate than state-of-the-art systems. MilliSonic enables two previously infeasible interaction applications: a) 3D tracking of VR headsets using the smartphone as a beacon and b) fine-grained 3D tracking for the Google Cardboard VR system using a small microphone array.

READ FULL TEXT
research
11/20/2018

Proceedings of the LOCATA Challenge Workshop - a satellite event of IWAENC 2018

Algorithms for acoustic source localization and tracking provide estimat...
research
03/09/2017

Position Tracking for Virtual Reality Using Commodity WiFi

Today, experiencing virtual reality (VR) is a cumbersome experience whic...
research
09/02/2023

Towards High-Frequency Tracking and Fast Edge-Aware Optimization

This dissertation advances the state of the art for AR/VR tracking syste...
research
07/24/2023

XRLoc: Accurate UWB Localization for XR Systems

Understanding the location of ultra-wideband (UWB) tag-attached objects ...
research
01/24/2023

WhisperWand: Simultaneous Voice and Gesture Tracking Interface

This paper presents the design and implementation of WhisperWand, a comp...
research
01/24/2023

Side Eye: Characterizing the Limits of POV Acoustic Eavesdropping from Smartphone Cameras with Rolling Shutters and Movable Lenses

Our research discovers how the rolling shutter and movable lens structur...
research
03/09/2018

VR Content Capture using Aligned Smartphones

There are a number of dedicated 3D capture devices in the market, but ge...

Please sign up or login with your details

Forgot password? Click here to reset