A Rotation Invariant Latent Factor Model for Moveme Discovery from Static Poses

09/23/2016
by   Matteo Ruggero Ronchi, et al.
0

We tackle the problem of learning a rotation invariant latent factor model when the training data is comprised of lower-dimensional projections of the original feature space. The main goal is the discovery of a set of 3-D bases poses that can characterize the manifold of primitive human motions, or movemes, from a training set of 2-D projected poses obtained from still images taken at various camera angles. The proposed technique for basis discovery is data-driven rather than hand-designed. The learned representation is rotation invariant, and can reconstruct any training instance from multiple viewing angles. We apply our method to modeling human poses in sports (via the Leeds Sports Dataset), and demonstrate the effectiveness of the learned bases in a range of applications such as activity classification, inference of dynamics from a single frame, and synthetic representation of movements.

READ FULL TEXT

page 1

page 6

page 7

page 9

research
12/08/2020

Rotation-Invariant Autoencoders for Signals on Spheres

Omnidirectional images and spherical representations of 3D shapes cannot...
research
03/06/2023

CRIN: Rotation-Invariant Point Cloud Analysis and Rotation Estimation via Centrifugal Reference Frame

Various recent methods attempt to implement rotation-invariant 3D deep l...
research
12/17/2018

On the Continuity of Rotation Representations in Neural Networks

In neural networks, it is often desirable to work with various represent...
research
07/19/2023

Learning from Abstract Images: on the Importance of Occlusion in a Minimalist Encoding of Human Poses

Existing 2D-to-3D pose lifting networks suffer from poor performance in ...
research
03/10/2022

ReF – Rotation Equivariant Features for Local Feature Matching

Sparse local feature matching is pivotal for many computer vision and ro...
research
03/29/2021

A tutorial on 𝐒𝐄(3) transformation parameterizations and on-manifold optimization

An arbitrary rigid transformation in 𝐒𝐄(3) can be separated into two par...
research
03/08/2021

Data-driven Cloud Clustering via a Rotationally Invariant Autoencoder

Advanced satellite-born remote sensing instruments produce high-resoluti...

Please sign up or login with your details

Forgot password? Click here to reset