DeepAI AI Chat
Log In Sign Up

HoloLens 2 Research Mode as a Tool for Computer Vision Research

08/25/2020
by   Dorin Ungureanu, et al.
20

Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research. In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams. We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data. We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2. By releasing the Research Mode API and a set of open-source tools, we aim to foster further research in the fields of computer vision as well as robotics and encourage contributions from the research community.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

03/19/2022

Volkit: A Performance-Portable Computer Vision Library for 3D Volumetric Data

We present volkit, an open source library with high performance implemen...
05/11/2017

Reconfiguring the Imaging Pipeline for Computer Vision

Advancements in deep learning have ignited an explosion of research on e...
01/10/2022

DiOS – An Extended Reality Operating System for the Metaverse

Driven by the recent improvements in device and networks capabilities, E...
01/26/2022

On the Issues of TrueDepth Sensor Data for Computer Vision Tasks Across Different iPad Generations

In 2017 Apple introduced the TrueDepth sensor with the iPhone X release....
10/08/2013

A State Of the Art Report on Research in Multiple RGB-D sensor Setups

That the Microsoft Kinect, an RGB-D sensor, transformed the gaming and e...
08/13/2021

yupi: Generation, Tracking and Analysis of Trajectory data in Python

The study of trajectories resulting from the motion of particles, object...

Code Repositories

HoloLens2ForCV

Sample code and documentation for using the Microsoft HoloLens 2 for Computer Vision research.


view repo

OpenCV-ZBar-ZXing

QR code detection with OpenCV, ZBar, ZXing integration using Visual Studio 2019


view repo