WrappingNet: Mesh Autoencoder via Deep Sphere Deformation

08/29/2023
by   Eric Lei, et al.
0

There have been recent efforts to learn more meaningful representations via fixed length codewords from mesh data, since a mesh serves as a complete model of underlying 3D shape compared to a point cloud. However, the mesh connectivity presents new difficulties when constructing a deep learning pipeline for meshes. Previous mesh unsupervised learning approaches typically assume category-specific templates, e.g., human face/body templates. It restricts the learned latent codes to only be meaningful for objects in a specific category, so the learned latent spaces are unable to be used across different types of objects. In this work, we present WrappingNet, the first mesh autoencoder enabling general mesh unsupervised learning over heterogeneous objects. It introduces a novel base graph in the bottleneck dedicated to representing mesh connectivity, which is shown to facilitate learning a shared latent space representing object shape. The superiority of WrappingNet mesh learning is further demonstrated via improved reconstruction quality and competitive classification compared to point cloud learning, as well as latent interpolation between meshes of different categories.

READ FULL TEXT

page 7

page 11

page 12

page 13

research
10/21/2021

Multi-Category Mesh Reconstruction From Image Collections

Recently, learning frameworks have shown the capability of inferring the...
research
10/21/2022

Isomorphic mesh generation from point clouds with multilayer perceptrons

We propose a new neural network, called isomorphic mesh generator (iMG),...
research
06/08/2020

Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernels

Learning latent representations of registered meshes is useful for many ...
research
05/24/2019

DEMEA: Deep Mesh Autoencoders for Non-Rigidly Deforming Objects

Mesh autoencoders are commonly used for dimensionality reduction, sampli...
research
05/04/2019

Single Image 3D Hand Reconstruction with Mesh Convolutions

Monocular 3D reconstruction of deformable objects, such as human body pa...
research
10/18/2021

Mesh Convolutional Autoencoder for Semi-Regular Meshes of Different Sizes

The analysis of deforming 3D surface meshes is accelerated by autoencode...
research
05/14/2019

Learning 3D Human Body Embedding

Although human body shapes vary for different identities with different ...

Please sign up or login with your details

Forgot password? Click here to reset