Learning Material-Aware Local Descriptors for 3D Shapes

10/20/2018
by   Hubert Lin, et al.
4

Material understanding is critical for design, geometric modeling, and analysis of functional objects. We enable material-aware 3D shape analysis by employing a projective convolutional neural network architecture to learn material- aware descriptors from view-based representations of 3D points for point-wise material classification or material- aware retrieval. Unfortunately, only a small fraction of shapes in 3D repositories are labeled with physical mate- rials, posing a challenge for learning methods. To address this challenge, we crowdsource a dataset of 3080 3D shapes with part-wise material labels. We focus on furniture models which exhibit interesting structure and material variabil- ity. In addition, we also contribute a high-quality expert- labeled benchmark of 115 shapes from Herman-Miller and IKEA for evaluation. We further apply a mesh-aware con- ditional random field, which incorporates rotational and reflective symmetries, to smooth our local material predic- tions across neighboring surface patches. We demonstrate the effectiveness of our learned descriptors for automatic texturing, material-aware retrieval, and physical simulation. The dataset and code will be publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 8

page 16

research
08/17/2023

Automated Characterization and Monitoring of Material Shape using Riemannian Geometry

Shape affects both the physical and chemical properties of a material. C...
research
08/13/2014

Learning Multi-Scale Representations for Material Classification

The recent progress in sparse coding and deep learning has made unsuperv...
research
12/16/2021

Reprogrammable Surfaces Through Star Graph Metamaterials

The ability to change a surface's profile allows biological systems to e...
research
06/14/2017

Learning Local Shape Descriptors from Part Correspondences With Multi-view Convolutional Networks

We present a new local descriptor for 3D shapes, directly applicable to ...
research
09/27/2018

Geometry-Aware Network for Non-Rigid Shape Prediction from a Single View

We propose a method for predicting the 3D shape of a deformable surface ...
research
02/01/2023

Equivariant Message Passing Neural Network for Crystal Material Discovery

Automatic material discovery with desired properties is a fundamental ch...
research
08/05/2021

SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design

Head shapes play an important role in 3D character design. In this work,...

Please sign up or login with your details

Forgot password? Click here to reset