Synchronized Smartphone Video Recording System of Depth and RGB Image Frames with Sub-millisecond Precision

11/05/2021
by   Marsel Faizullin, et al.
0

In this paper, we propose a recording system with high time synchronization (sync) precision which consists of heterogeneous sensors such as smartphone, depth camera, IMU, etc. Due to the general interest and mass adoption of smartphones, we include at least one of such devices into our system. This heterogeneous system requires a hybrid synchronization for the two different time authorities: smartphone and MCU, where we combine a hardware wired-based trigger sync with software sync. We evaluate our sync results on a custom and novel system mixing active infra-red depth with RGB camera. Our system achieves sub-millisecond precision of time sync. Moreover, our system exposes every RGB-depth image pair at the same time with this precision. We showcase a configuration in particular but the general principles behind our system could be replicated by other projects.

READ FULL TEXT

page 1

page 3

page 7

research
04/21/2022

SmartPortraits: Depth Powered Handheld Smartphone Dataset of Human Portraits for State Estimation, Reconstruction and Synthesis

We present a dataset of 1000 video sequences of human portraits recorded...
research
10/07/2019

A Novel Technique of Noninvasive Hemoglobin Level Measurement Using HSV Value of Fingertip Image

Over the last decade, smartphones have changed radically to support us w...
research
07/02/2021

Sub-millisecond Video Synchronization of Multiple Android Smartphones

This paper addresses the problem of building an affordable easy-to-setup...
research
01/09/2019

Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera

Depth sensing is crucial for 3D reconstruction and scene understanding. ...
research
10/11/2022

ViFiCon: Vision and Wireless Association Via Self-Supervised Contrastive Learning

We introduce ViFiCon, a self-supervised contrastive learning scheme whic...
research
10/12/2016

Video Depth-From-Defocus

Many compelling video post-processing effects, in particular aesthetic f...
research
06/30/2022

Neural Network Assisted Depth Map Packing for Compression Using Standard Hardware Video Codecs

Depth maps are needed by various graphics rendering and processing opera...

Please sign up or login with your details

Forgot password? Click here to reset