DeepAI
Log In Sign Up

Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking

06/22/2021
by   Hau Chu, et al.
1

This paper introduces an approach for multi-human 3D pose estimation and tracking based on calibrated multi-view. The main challenge lies in finding the cross-view and temporal correspondences correctly even when several human pose estimations are noisy. Compare to previous solutions that construct 3D poses from multiple views, our approach takes advantage of temporal consistency to match the 2D poses estimated with previously constructed 3D skeletons in every view. Therefore cross-view and temporal associations are accomplished simultaneously. Since the performance suffers from mistaken association and noisy predictions, we design two strategies for aiming better correspondences and 3D reconstruction. Specifically, we propose a part-aware measurement for 2D-3D association and a filter that can cope with 2D outliers during reconstruction. Our approach is efficient and effective comparing to state-of-the-art methods; it achieves competitive results on two benchmarks: 96.8 evaluation frames to be more challenging and our proposal also reach well-performed result.

READ FULL TEXT

page 2

page 7

page 8

page 10

03/09/2020

Cross-View Tracking for Multi-Human 3D Pose Estimation at over 100 FPS

Estimating 3D poses of multiple humans in real-time is a classic but sti...
02/07/2019

3D Human Pose Estimation from Deep Multi-View 2D Pose

Human pose estimation - the process of recognizing a human's limb positi...
04/06/2021

Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo

Existing approaches for multi-view multi-person 3D pose estimation expli...
06/10/2021

SVMA: A GAN-based model for Monocular 3D Human Pose Estimation

Recovering 3D human pose from 2D joints is a highly unconstrained proble...
01/24/2021

Iterative Greedy Matching for 3D Human Pose Tracking from Multiple Views

In this work we propose an approach for estimating 3D human poses of mul...
12/09/2019

DeepFuse: An IMU-Aware Network for Real-Time 3D Human Pose Estimation from Multi-View Image

In this paper, we propose a two-stage fully 3D network, namely DeepFuse,...
08/05/2021

VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild

We present VoxelTrack for multi-person 3D pose estimation and tracking f...

Code Repositories

Part-Aware_Measurement_for_3D_Pose_Estimation_and_Tracking

None


view repo