Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Images

09/13/2021
by   Size Wu, et al.
0

This paper studies the task of estimating the 3D human poses of multiple persons from multiple calibrated camera views. Following the top-down paradigm, we decompose the task into two stages, i.e. person localization and pose estimation. Both stages are processed in coarse-to-fine manners. And we propose three task-specific graph neural networks for effective message passing. For 3D person localization, we first use Multi-view Matching Graph Module (MMG) to learn the cross-view association and recover coarse human proposals. The Center Refinement Graph Module (CRG) further refines the results via flexible point-based prediction. For 3D pose estimation, the Pose Regression Graph Module (PRG) learns both the multi-view geometry and structural relations between human joints. Our approach achieves state-of-the-art performance on CMU Panoptic and Shelf datasets with significantly lower computation complexity.

READ FULL TEXT

page 4

page 8

page 13

research
04/06/2021

Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo

Existing approaches for multi-view multi-person 3D pose estimation expli...
research
02/07/2019

3D Human Pose Estimation from Deep Multi-View 2D Pose

Human pose estimation - the process of recognizing a human's limb positi...
research
01/17/2022

Graph Neural Networks for Cross-Camera Data Association

Cross-camera image data association is essential for many multi-camera c...
research
04/11/2020

Multi-View Matching (MVM): Facilitating Multi-Person 3D Pose Estimation Learning with Action-Frozen People Video

To tackle the challeging problem of multi-person 3D pose estimation from...
research
08/21/2022

CenDerNet: Center and Curvature Representations for Render-and-Compare 6D Pose Estimation

We introduce CenDerNet, a framework for 6D pose estimation from multi-vi...
research
08/21/2023

Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Images

We propose a novel transformer-based framework that reconstructs two hig...
research
09/28/2017

X-View: Graph-Based Semantic Multi-View Localization

Global registration of multi-view robot data is a challenging task. Appe...

Please sign up or login with your details

Forgot password? Click here to reset