Laplacian2Mesh: Laplacian-Based Mesh Understanding

02/01/2022
by   Qiujie Dong, et al.
0

Geometric deep learning has sparked a rising interest in computer graphics to perform shape understanding tasks, such as shape classification and semantic segmentation on three-dimensional (3D) geometric surfaces. Previous works explored the significant direction by defining the operations of convolution and pooling on triangle meshes, but most methods explicitly utilized the graph connection structure of the mesh. Motivated by the geometric spectral surface reconstruction theory, we introduce a novel and flexible convolutional neural network (CNN) model, called Laplacian2Mesh, for 3D triangle mesh, which maps the features of mesh in the Euclidean space to the multi-dimensional Laplacian-Beltrami space, which is similar to the multi-resolution input in 2D CNN. Mesh pooling is applied to expand the receptive field of the network by the multi-space transformation of Laplacian which retains the surface topology, and channel self-attention convolutions are applied in the new space. Since implicitly using the intrinsic geodesic connections of the mesh through the adjacency matrix, we do not consider the number of the neighbors of the vertices, thereby mesh data with different numbers of vertices can be input. Experiments on various learning tasks applied to 3D meshes demonstrate the effectiveness and efficiency of Laplacian2Mesh.

READ FULL TEXT

Authors

page 2

page 5

page 8

page 9

page 10

page 11

10/23/2020

Primal-Dual Mesh Convolutional Neural Networks

Recent works in geometric deep learning have introduced neural networks ...
09/16/2018

MeshCNN: A Network with an Edge

A polygonal mesh representation provides an efficient approximation for ...
10/30/2019

LaplacianNet: Learning on 3D Meshes with Laplacian Encoding and Pooling

3D models are commonly used in computer vision and graphics. With the wi...
04/02/2020

DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes

We propose DualConvMesh-Nets (DCM-Net) a family of deep hierarchical con...
06/13/2013

Multimaterial Front Tracking

We present the first triangle mesh-based technique for tracking the evol...
08/15/2018

Convolutional Neural Networks on 3D Surfaces Using Parallel Frames

We extend Convolutional Neural Networks (CNNs) on flat and regular domai...
03/28/2021

Picasso: A CUDA-based Library for Deep Learning over 3D Meshes

We present Picasso, a CUDA-based library comprising novel modules for de...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.