Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysis

03/14/2023
by   Renrui Zhang, et al.
0

We present a Non-parametric Network for 3D point cloud analysis, Point-NN, which consists of purely non-learnable components: farthest point sampling (FPS), k-nearest neighbors (k-NN), and pooling operations, with trigonometric functions. Surprisingly, it performs well on various 3D tasks, requiring no parameters or training, and even surpasses existing fully trained models. Starting from this basic non-parametric model, we propose two extensions. First, Point-NN can serve as a base architectural framework to construct Parametric Networks by simply inserting linear layers on top. Given the superior non-parametric foundation, the derived Point-PN exhibits a high performance-efficiency trade-off with only a few learnable parameters. Second, Point-NN can be regarded as a plug-and-play module for the already trained 3D models during inference. Point-NN captures the complementary geometric knowledge and enhances existing methods for different 3D benchmarks without re-training. We hope our work may cast a light on the community for understanding 3D point clouds with non-parametric methods. Code is available at https://github.com/ZrrSkywalker/Point-NN.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/01/2023

Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis

Performances on standard 3D point cloud benchmarks have plateaued, resul...
research
09/01/2023

Point-Bind Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following

We introduce Point-Bind, a 3D multi-modality model aligning point clouds...
research
08/16/2021

PnP-3D: A Plug-and-Play for 3D Point Clouds

With the help of the deep learning paradigm, many point cloud networks h...
research
03/14/2023

Parametric Surface Constrained Upsampler Network for Point Cloud

Designing a point cloud upsampler, which aims to generate a clean and de...
research
02/15/2022

Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework

Point cloud analysis is challenging due to irregularity and unordered da...
research
02/24/2023

NoPPA: Non-Parametric Pairwise Attention Random Walk Model for Sentence Representation

We propose a novel non-parametric/un-trainable language model, named Non...
research
12/15/2021

Rethinking Nearest Neighbors for Visual Classification

Neural network classifiers have become the de-facto choice for current "...

Please sign up or login with your details

Forgot password? Click here to reset