A Review of Deep Learning Techniques for Markerless Human Motion on Synthetic Datasets

by   Doan Duy Vo, et al.

Markerless motion capture has become an active field of research in computer vision in recent years. Its extensive applications are known in a great variety of fields, including computer animation, human motion analysis, biomedical research, virtual reality, and sports science. Estimating human posture has recently gained increasing attention in the computer vision community, but due to the depth of uncertainty and the lack of the synthetic datasets, it is a challenging task. Various approaches have recently been proposed to solve this problem, many of which are based on deep learning. They are primarily focused on improving the performance of existing benchmarks with significant advances, especially 2D images. Based on powerful deep learning techniques and recently collected real-world datasets, we explored a model that can predict the skeleton of an animation based solely on 2D images. Frames generated from different real-world datasets with synthesized poses using different body shapes from simple to complex. The implementation process uses DeepLabCut on its own dataset to perform many necessary steps, then use the input frames to train the model. The output is an animated skeleton for human movement. The composite dataset and other results are the "ground truth" of the deep model.


page 4

page 7

page 9


Adversarial Attention for Human Motion Synthesis

Analysing human motions is a core topic of interest for many disciplines...

Automatic Estimation of Anthropometric Human Body Measurements

Research tasks related to human body analysis have been drawing a lot of...

Structured Memory based Deep Model to Detect as well as Characterize Novel Inputs

While deep learning has pushed the boundaries in various machine learnin...

Synthetic Human Model Dataset for Skeleton Driven Non-rigid Motion Tracking and 3D Reconstruction

We introduce a synthetic dataset for evaluating non-rigid 3D human recon...

RGB-D-based Human Motion Recognition with Deep Learning: A Survey

Human motion recognition is one of the most important branches of human-...

A Survey on Deep Learning for Skeleton-Based Human Animation

Human character animation is often critical in entertainment content pro...

BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fields

Neural rendering combines ideas from classical computer graphics and mac...

Please sign up or login with your details

Forgot password? Click here to reset