Unsupervised Learning on Monocular Videos for 3D Human Pose Estimation

12/02/2020
by   Sina Honari, et al.
3

In this paper, we introduce an unsupervised feature extraction method that exploits contrastive self-supervised (CSS) learning to extract rich latent vectors from single-view videos. Instead of simply treating the latent features of nearby frames as positive pairs and those of temporally-distant ones as negative pairs as in other CSS approaches, we explicitly separate each latent vector into a time-variant component and a time-invariant one. We then show that applying CSS only to the time-variant features, while also reconstructing the input and encouraging a gradual transition between nearby and away features yields a rich latent space, well-suited for human pose estimation. Our approach outperforms other unsupervised single-view methods and match the performance of multi-view techniques.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 3

page 8

page 11

page 12

page 13

page 14

page 15

04/05/2022

Non-Local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation

Available 3D human pose estimation approaches leverage different forms o...
04/09/2019

Unsupervised 3D Pose Estimation with Geometric Self-Supervision

We present an unsupervised learning approach to recover 3D human pose fr...
01/07/2020

Deep Reinforcement Learning for Active Human Pose Estimation

Most 3d human pose estimation methods assume that input – be it images o...
10/13/2020

Self-Supervised Multi-View Synchronization Learning for 3D Pose Estimation

Current state-of-the-art methods cast monocular 3D human pose estimation...
08/14/2019

3D Human Pose Estimation under limited supervision using Metric Learning

Estimating 3D human pose from monocular images demands large amounts of ...
09/17/2021

Unsupervised View-Invariant Human Posture Representation

Most recent view-invariant action recognition and performance assessment...
12/16/2018

Human Pose and Path Estimation from Aerial Video using Dynamic Classifier Selection

We consider the problem of estimating human pose and trajectory by an ae...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.