Learning Semantic Abstraction of Shape via 3D Region of Interest

01/13/2022
by   Haiyue Fang, et al.
14

In this paper, we focus on the two tasks of 3D shape abstraction and semantic analysis. This is in contrast to current methods, which focus solely on either 3D shape abstraction or semantic analysis. In addition, previous methods have had difficulty producing instance-level semantic results, which has limited their application. We present a novel method for the joint estimation of a 3D shape abstraction and semantic analysis. Our approach first generates a number of 3D semantic candidate regions for a 3D shape; we then employ these candidates to directly predict the semantic categories and refine the parameters of the candidate regions simultaneously using a deep convolutional neural network. Finally, we design an algorithm to fuse the predicted results and obtain the final semantic abstraction, which is shown to be an improvement over a standard non maximum suppression. Experimental results demonstrate that our approach can produce state-of-the-art results. Moreover, we also find that our results can be easily applied to instance-level semantic part segmentation and shape matching.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 9

research
09/09/2015

Proposal-free Network for Instance-level Object Segmentation

Instance-level object segmentation is an important yet under-explored ta...
research
06/07/2021

Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds

Representing complex 3D objects as simple geometric primitives, known as...
research
11/02/2020

MARNet: Multi-Abstraction Refinement Network for 3D Point Cloud Analysis

Representation learning from 3D point clouds is challenging due to their...
research
10/18/2020

Shape Constrained CNN for Cardiac MR Segmentation with Simultaneous Prediction of Shape and Pose Parameters

Semantic segmentation using convolutional neural networks (CNNs) is the ...
research
12/27/2019

An Abstraction Model for Semantic Segmentation Algorithms

Semantic segmentation is a process of classifying each pixel in the imag...
research
06/22/2021

The Neurally-Guided Shape Parser: A Monte Carlo Method for Hierarchical Labeling of Over-segmented 3D Shapes

Many learning-based 3D shape semantic segmentation methods assign labels...
research
04/20/2016

A Deep Neural Network for Chinese Zero Pronoun Resolution

Existing approaches for Chinese zero pronoun resolution overlook semanti...

Please sign up or login with your details

Forgot password? Click here to reset