A New Spatio-Temporal Loss Function for 3D Motion Reconstruction and Extended Temporal Metrics for Motion Evaluation

10/16/2022
by   Mansour Tchenegnon, et al.
0

We propose a new loss function that we call Laplacian loss, based on spatio-temporal Laplacian representation of the motion as a graph. This loss function is intended to be used in training models for motion reconstruction through 3D human pose estimation from videos. It compares the differential coordinates of the joints obtained from the graph representation of the ground truth against the one of the estimation. We design a fully convolutional temporal network for motion reconstruction to achieve better temporal consistency of estimation. We use this generic model to study the impact of our proposed loss function on the benchmarks provided by Human3.6M. We also make use of various motion descriptors such as velocity, acceleration to make a thorough evaluation of the temporal consistency while comparing the results to some of the state-of-the-art solutions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2020

Motion Guided 3D Pose Estimation from Videos

We propose a new loss function, called motion loss, for the problem of m...
research
07/25/2022

Live Stream Temporally Embedded 3D Human Body Pose and Shape Estimation

3D Human body pose and shape estimation within a temporal sequence can b...
research
03/11/2020

GAST-Net: Graph Attention Spatio-temporal Convolutional Networks for 3D Human Pose Estimation in Video

3D pose estimation in video can benefit greatly from both temporal and s...
research
03/16/2023

Learning Spatio-Temporal Aggregations for Large-Scale Capacity Expansion Problems

Effective investment planning decisions are crucial to ensure cyber-phys...
research
03/21/2022

Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Loss

We present a lightweight neural model for remote heart rate estimation f...
research
10/08/2022

(Fusionformer):Exploiting the Joint Motion Synergy with Fusion Network Based On Transformer for 3D Human Pose Estimation

For the current 3D human pose estimation task, in order to improve the e...
research
04/08/2019

Referring to Objects in Videos using Spatio-Temporal Identifying Descriptions

This paper presents a new task, the grounding of spatio-temporal identif...

Please sign up or login with your details

Forgot password? Click here to reset