SmartPortraits: Depth Powered Handheld Smartphone Dataset of Human Portraits for State Estimation, Reconstruction and Synthesis

04/21/2022
by   Anastasiia Kornilova, et al.
0

We present a dataset of 1000 video sequences of human portraits recorded in real and uncontrolled conditions by using a handheld smartphone accompanied by an external high-quality depth camera. The collected dataset contains 200 people captured in different poses and locations and its main purpose is to bridge the gap between raw measurements obtained from a smartphone and downstream applications, such as state estimation, 3D reconstruction, view synthesis, etc. The sensors employed in data collection are the smartphone's camera and Inertial Measurement Unit (IMU), and an external Azure Kinect DK depth camera software synchronized with sub-millisecond precision to the smartphone system. During the recording, the smartphone flash is used to provide a periodic secondary source of lightning. Accurate mask of the foremost person is provided as well as its impact on the camera alignment accuracy. For evaluation purposes, we compare multiple state-of-the-art camera alignment methods by using a Motion Capture system. We provide a smartphone visual-inertial benchmark for portrait capturing, where we report results for multiple methods and motivate further use of the provided trajectories, available in the dataset, in view synthesis and 3D reconstruction tasks.

READ FULL TEXT

page 1

page 4

page 8

research
11/05/2021

Synchronized Smartphone Video Recording System of Depth and RGB Image Frames with Sub-millisecond Precision

In this paper, we propose a recording system with high time synchronizat...
research
09/03/2023

BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking

Robust, fast, and accurate human state - 6D pose and posture - estimatio...
research
12/14/2018

A Commute in Data: The comma2k19 Dataset

comma.ai presents comma2k19, a dataset of over 33 hours of commute in Ca...
research
06/23/2015

Autonomous 3D Reconstruction Using a MAV

An approach is proposed for high resolution 3D reconstruction of an obje...
research
06/16/2023

A context model for collecting diversity-aware data

Diversity-aware data are essential for a robust modeling of human behavi...
research
03/31/2021

Smartphone Camera Oximetry in an Induced Hypoxemia Study

Hypoxemia, a medical condition that occurs when the blood is not carryin...
research
02/21/2023

Quantifying Jump Height Using Markerless Motion Capture with a Single Smartphone

Goal: The countermovement jump (CMJ) is commonly used to measure the exp...

Please sign up or login with your details

Forgot password? Click here to reset