UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capture

08/02/2022
by   Hiroyasu Akada, et al.
1

We present UnrealEgo, i.e., a new large-scale naturalistic dataset for egocentric 3D human pose estimation. UnrealEgo is based on an advanced concept of eyeglasses equipped with two fisheye cameras that can be used in unconstrained environments. We design their virtual prototype and attach them to 3D human models for stereo view capture. We next generate a large corpus of human motions. As a consequence, UnrealEgo is the first dataset to provide in-the-wild stereo images with the largest variety of motions among existing egocentric datasets. Furthermore, we propose a new benchmark method with a simple but effective idea of devising a 2D keypoint estimation module for stereo inputs to improve 3D human pose estimation. The extensive experiments show that our approach outperforms the previous state-of-the-art methods qualitatively and quantitatively. UnrealEgo and our source codes are available on our project web page.

READ FULL TEXT

page 2

page 3

page 12

page 13

page 20

page 21

research
01/20/2022

Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervision

Egocentric 3D human pose estimation with a single fisheye camera has dra...
research
06/04/2022

SPGNet: Spatial Projection Guided 3D Human Pose Estimation in Low Dimensional Space

We propose a method SPGNet for 3D human pose estimation that mixes multi...
research
06/07/2019

Ego-Pose Estimation and Forecasting as Real-Time PD Control

We propose the use of a proportional-derivative (PD) control based polic...
research
02/12/2019

Post-Data Augmentation to Improve Deep Pose Estimation of Extreme and Wild Motions

Contributions of recent deep-neural-network (DNN) based techniques have ...
research
09/24/2021

Catadioptric Stereo on a Smartphone

We present a 3D printed adapter with planar mirrors for stereo reconstru...
research
04/29/2020

Motion Guided 3D Pose Estimation from Videos

We propose a new loss function, called motion loss, for the problem of m...
research
11/30/2021

Camera Distortion-aware 3D Human Pose Estimation in Video with Optimization-based Meta-Learning

Existing 3D human pose estimation algorithms trained on distortion-free ...

Please sign up or login with your details

Forgot password? Click here to reset