Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernels

06/08/2020
by   Yi Zhou, et al.
20

Learning latent representations of registered meshes is useful for many 3D tasks. Techniques have recently shifted to neural mesh autoencoders. Although they demonstrate higher precision than traditional methods, they remain unable to capture fine-grained deformations. Furthermore, these methods can only be applied to a template-specific surface mesh, and is not applicable to more general meshes, like tetrahedrons and non-manifold meshes. While more general graph convolution methods can be employed, they lack performance in reconstruction precision and require higher memory usage. In this paper, we propose a non-template-specific fully convolutional mesh autoencoder for arbitrary registered mesh data. It is enabled by our novel convolution and (un)pooling operators learned with globally shared weights and locally varying coefficients which can efficiently capture the spatially varying contents presented by irregular mesh connections. Our model outperforms state-of-the-art methods on reconstruction accuracy. In addition, the latent codes of our network are fully localized thanks to the fully convolutional structure, and thus have much higher interpolation capability than many traditional 3D mesh generation models.

READ FULL TEXT

page 6

page 7

page 12

research
10/18/2021

Mesh Convolutional Autoencoder for Semi-Regular Meshes of Different Sizes

The analysis of deforming 3D surface meshes is accelerated by autoencode...
research
09/13/2017

Mesh-based Autoencoders for Localized Deformation Component Analysis

Spatially localized deformation components are very useful for shape ana...
research
08/29/2023

WrappingNet: Mesh Autoencoder via Deep Sphere Deformation

There have been recent efforts to learn more meaningful representations ...
research
07/26/2018

Generating 3D faces using Convolutional Mesh Autoencoders

Learned 3D representations of human faces are useful for computer vision...
research
06/10/2022

Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes

This paper introduces a novel framework called DTNet for 3D mesh reconst...
research
05/23/2020

Unsupervised Geometric Disentanglement for Surfaces via CFAN-VAE

For non-Euclidean data such as meshes of humans, a prominent task for ge...
research
12/12/2022

Transfer Learning using Spectral Convolutional Autoencoders on Semi-Regular Surface Meshes

The underlying dynamics and patterns of 3D surface meshes deforming over...

Please sign up or login with your details

Forgot password? Click here to reset