Variational Autoencoders for Deforming 3D Mesh Models

09/13/2017
by   Qingyang Tan, et al.
0

3D geometric contents are becoming increasingly popular. In this paper, we study the problem of analyzing deforming 3D meshes using deep neural networks. Deforming 3D meshes are flexible to represent 3D animation sequences as well as collections of objects of the same category, allowing diverse shapes with large-scale non-linear deformations. We propose a novel framework which we call mesh variational autoencoders (mesh VAE), to explore the probabilistic latent space of 3D surfaces. The framework is easy to train, and requires very few training examples. We also propose an extended model which allows flexibly adjusting the significance of different latent variables by altering the prior distribution. Extensive experiments demonstrate that our general framework is able to learn a reasonable representation for a collection of deformable shapes, and produce competitive results for a variety of applications, including shape generation, shape interpolation, shape space embedding and shape exploration, outperforming state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2019

Latent feature disentanglement for 3D meshes

Generative modeling of 3D shapes has become an important problem due to ...
research
05/23/2020

Unsupervised Geometric Disentanglement for Surfaces via CFAN-VAE

For non-Euclidean data such as meshes of humans, a prominent task for ge...
research
06/11/2018

Latent Space Representation for Shape Analysis and Learning

We propose a novel shape representation useful for analyzing and process...
research
05/04/2019

Single Image 3D Hand Reconstruction with Mesh Convolutions

Monocular 3D reconstruction of deformable objects, such as human body pa...
research
08/07/2019

Mesh Variational Autoencoders with Edge Contraction Pooling

3D shape analysis is an important research topic in computer vision and ...
research
11/24/2022

SAGA: Spectral Adversarial Geometric Attack on 3D Meshes

A triangular mesh is one of the most popular 3D data representations. As...
research
04/05/2023

Shape complexity estimation using VAE

In this paper, we compare methods for estimating the complexity of two-d...

Please sign up or login with your details

Forgot password? Click here to reset