Unsupervised Geometric Disentanglement for Surfaces via CFAN-VAE

05/23/2020
by   N. Joseph Tatro, et al.
16

For non-Euclidean data such as meshes of humans, a prominent task for generative models is geometric disentanglement; the separation of latent codes for intrinsic (i.e. identity) and extrinsic (i.e. pose) geometry. This work introduces a novel mesh feature, the conformal factor and normal feature (CFAN), for use in mesh convolutional autoencoders. We further propose CFAN-VAE, a novel architecture that disentangles identity and pose using the CFAN feature and parallel transport convolution. CFAN-VAE achieves this geometric disentanglement in an unsupervised way, as it does not require label information on the identity or pose during training. Our comprehensive experiments, including reconstruction, interpolation, generation, and canonical correlation analysis, validate the effectiveness of the unsupervised geometric disentanglement. We also successfully detect and recover geometric disentanglement in mesh convolutional autoencoders that encode xyz-coordinates directly by registering its latent space to that of CFAN-VAE.

READ FULL TEXT

page 3

page 7

page 8

page 9

page 10

page 16

page 17

research
09/13/2017

Variational Autoencoders for Deforming 3D Mesh Models

3D geometric contents are becoming increasingly popular. In this paper, ...
research
12/06/2022

Pixel2ISDF: Implicit Signed Distance Fields based Human Body Model from Multi-view and Multi-pose Images

In this report, we focus on reconstructing clothed humans in the canonic...
research
04/13/2017

Learning Latent Representations for Speech Generation and Transformation

An ability to model a generative process and learn a latent representati...
research
09/15/2022

A Geometric Perspective on Variational Autoencoders

This paper introduces a new interpretation of the Variational Autoencode...
research
07/30/2021

Data-driven modeling of time-domain induced polarization

We present a novel approach for data-driven modeling of the time-domain ...
research
08/17/2021

Intrinsic-Extrinsic Preserved GANs for Unsupervised 3D Pose Transfer

With the strength of deep generative models, 3D pose transfer regains in...
research
06/08/2020

Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernels

Learning latent representations of registered meshes is useful for many ...

Please sign up or login with your details

Forgot password? Click here to reset