A Deep Recurrent Framework for Cleaning Motion Capture Data

12/09/2017
by   Utkarsh Mall, et al.
0

We present a deep, bidirectional, recurrent framework for cleaning noisy and incomplete motion capture data. It exploits temporal coherence and joint correlations to infer adaptive filters for each joint in each frame. A single model can be trained to denoise a heterogeneous mix of action types, under substantial amounts of noise. A signal that has both noise and gaps is preprocessed with a second bidirectional network that synthesizes missing frames from surrounding context. The approach handles a wide variety of noise types and long gaps, does not rely on knowledge of the noise distribution, and operates in a streaming setting. We validate our approach through extensive evaluations on noise both in joint angles and in joint positions, and show that it improves upon various alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/18/2022

Deep Multi-Frame MVDR Filtering for Binaural Noise Reduction

To improve speech intelligibility and speech quality in noisy environmen...
research
07/02/2023

Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animation

We introduce a method to generate temporally coherent human animation fr...
research
08/31/2017

Joint Separation and Denoising of Noisy Multi-talker Speech using Recurrent Neural Networks and Permutation Invariant Training

In this paper we propose to use utterance-level Permutation Invariant Tr...
research
04/27/2021

Three-stream network for enriched Action Recognition

Understanding accurate information on human behaviours is one of the mos...
research
10/22/2020

Convolutional Autoencoders for Human Motion Infilling

In this paper we propose a convolutional autoencoder to address the prob...
research
11/14/2018

Creatures great and SMAL: Recovering the shape and motion of animals from video

We present a system to recover the 3D shape and motion of a wide variety...
research
08/27/2020

Cloze Test Helps: Effective Video Anomaly Detection via Learning to Complete Video Events

As a vital topic in media content interpretation, video anomaly detectio...

Please sign up or login with your details

Forgot password? Click here to reset