Rethinking PointNet Embedding for Faster and Compact Model

07/31/2020
by   Teppei Suzuki, et al.
0

PointNet, which is the widely used point-wise embedding method and known as a universal approximator for continuous set functions, can process one million points per second. Nevertheless, real-time inference for the recent development of high-performing sensors is still challenging with existing neural network-based methods, including PointNet. In ordinary cases, the embedding function of PointNet behaves like a soft-indicator function that is activated when the input points exist in a certain local region of the input space. Leveraging this property, we reduce the computational costs of point-wise embedding by replacing the embedding function of PointNet with the soft-indicator function by Gaussian kernels. Moreover, we show that the Gaussian kernels also satisfy the universal approximation theorem that PointNet satisfies. In experiments, we verify that our model using the Gaussian kernels achieves comparable results to baseline methods, but with much fewer floating-point operations per sample up to 92% reduction from PointNet.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2020

Universal Approximation Property of Neural Ordinary Differential Equations

Neural ordinary differential equations (NODEs) is an invertible neural n...
research
10/07/2021

Universal Approximation Under Constraints is Possible with Transformers

Many practical problems need the output of a machine learning model to s...
research
04/22/2021

Universal Horn Sentences and the Joint Embedding Property

The finite models of a universal sentence Φ are the age of a structure i...
research
11/01/2021

End-to-End Learning of Deep Kernel Acquisition Functions for Bayesian Optimization

For Bayesian optimization (BO) on high-dimensional data with complex str...
research
10/18/2017

Universal Convergence of Kriging

Kriging based on Gaussian random fields is widely used in reconstructing...
research
01/14/2020

Unsupervised Learning of the Set of Local Maxima

This paper describes a new form of unsupervised learning, whose input is...
research
08/27/2018

Field Formulation of Parzen Data Analysis

The Parzen window density is a well-known technique, associating Gaussia...

Please sign up or login with your details

Forgot password? Click here to reset