Dynamic Multi-Person Mesh Recovery From Uncalibrated Multi-View Cameras

10/20/2021
by   Buzhen Huang, et al.
0

Dynamic multi-person mesh recovery has been a hot topic in 3D vision recently. However, few works focus on the multi-person motion capture from uncalibrated cameras, which mainly faces two challenges: the one is that inter-person interactions and occlusions introduce inherent ambiguities for both camera calibration and motion capture; The other is that a lack of dense correspondences can be used to constrain sparse camera geometries in a dynamic multi-person scene. Our key idea is incorporating motion prior knowledge into simultaneous optimization of extrinsic camera parameters and human meshes from noisy human semantics. First, we introduce a physics-geometry consistency to reduce the low and high frequency noises of the detected human semantics. Then a novel latent motion prior is proposed to simultaneously optimize extrinsic camera parameters and coherent human motions from slightly noisy inputs. Experimental results show that accurate camera parameters and human motions can be obtained through one-stage optimization. The codes will be publicly available at <https://www.yangangwang.com>.

READ FULL TEXT

page 1

page 3

page 6

page 8

research
09/28/2022

SmartMocap: Joint Estimation of Human and Camera Motion using Uncalibrated RGB Cameras

Markerless human motion capture (mocap) from multiple RGB cameras is a w...
research
05/05/2021

FLEX: Parameter-free Multi-view 3D Human Motion Reconstruction

The increasing availability of video recordings made by multiple cameras...
research
12/02/2020

A Photogrammetry-based Framework to Facilitate Image-based Modeling and Automatic Camera Tracking

We propose a framework that extends Blender to exploit Structure from Mo...
research
08/18/2020

Motion Capture from Internet Videos

Recent advances in image-based human pose estimation make it possible to...
research
01/16/2020

Synergetic Reconstruction from 2D Pose and 3D Motion for Wide-Space Multi-Person Video Motion Capture in the Wild

Although many studies have been made on markerless motion capture, it ha...
research
02/28/2020

4D Association Graph for Realtime Multi-person Motion Capture Using Multiple Video Cameras

This paper contributes a novel realtime multi-person motion capture algo...
research
05/03/2022

Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networks

We present a learning algorithm that uses bone-driven motion networks to...

Please sign up or login with your details

Forgot password? Click here to reset