Log In Sign Up

Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo

by   Jiahao Lin, et al.

Existing approaches for multi-view multi-person 3D pose estimation explicitly establish cross-view correspondences to group 2D pose detections from multiple camera views and solve for the 3D pose estimation for each person. Establishing cross-view correspondences is challenging in multi-person scenes, and incorrect correspondences will lead to sub-optimal performance for the multi-stage pipeline. In this work, we present our multi-view 3D pose estimation approach based on plane sweep stereo to jointly address the cross-view fusion and 3D pose reconstruction in a single shot. Specifically, we propose to perform depth regression for each joint of each 2D pose in a target camera view. Cross-view consistency constraints are implicitly enforced by multiple reference camera views via the plane sweep algorithm to facilitate accurate depth regression. We adopt a coarse-to-fine scheme to first regress the person-level depth followed by a per-person joint-level relative depth estimation. 3D poses are obtained from a simple back-projection given the estimated depths. We evaluate our approach on benchmark datasets where it outperforms previous state-of-the-arts while being remarkably efficient. Our code is available at


page 3

page 5

page 8


Cross View Fusion for 3D Human Pose Estimation

We present an approach to recover absolute 3D human poses from multi-vie...

Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Images

This paper studies the task of estimating the 3D human poses of multiple...

NOPE-SAC: Neural One-Plane RANSAC for Sparse-View Planar 3D Reconstruction

This paper studies the challenging two-view 3D reconstruction in a rigor...

Real-time marker-less multi-person 3D pose estimation in RGB-Depth camera networks

This paper proposes a novel system to estimate and track the 3D poses of...

Direct Multi-view Multi-person 3D Pose Estimation

We present Multi-view Pose transformer (MvP) for estimating multi-person...

Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking

This paper introduces an approach for multi-human 3D pose estimation and...

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

This paper addresses the problem of 3D pose estimation for multiple peop...