Efficient Long-Range Convolutions for Point Clouds

10/11/2020
by   Yifan Peng, et al.
0

The efficient treatment of long-range interactions for point clouds is a challenging problem in many scientific machine learning applications. To extract global information, one usually needs a large window size, a large number of layers, and/or a large number of channels. This can often significantly increase the computational cost. In this work, we present a novel neural network layer that directly incorporates long-range information for a point cloud. This layer, dubbed the long-range convolutional (LRC)-layer, leverages the convolutional theorem coupled with the non-uniform Fourier transform. In a nutshell, the LRC-layer mollifies the point cloud to an adequately sized regular grid, computes its Fourier transform, multiplies the result by a set of trainable Fourier multipliers, computes the inverse Fourier transform, and finally interpolates the result back to the point cloud. The resulting global all-to-all convolution operation can be performed in nearly-linear time asymptotically with respect to the number of input points. The LRC-layer is a particularly powerful tool when combined with local convolution as together they offer efficient and seamless treatment of both short and long range interactions. We showcase this framework by introducing a neural network architecture that combines LRC-layers with short-range convolutional layers to accurately learn the energy and force associated with a N-body potential. We also exploit the induced two-level decomposition and propose an efficient strategy to train the combined architecture with a reduced number of samples.

READ FULL TEXT

page 5

page 12

page 15

research
06/02/2023

Collect-and-Distribute Transformer for 3D Point Cloud Analysis

Although remarkable advancements have been made recently in point cloud ...
research
01/07/2022

Block Walsh-Hadamard Transform Based Binary Layers in Deep Neural Networks

Convolution has been the core operation of modern deep neural networks. ...
research
08/14/2018

URSA: A Neural Network for Unordered Point Clouds Using Constellations

This paper describes a neural network layer, named URSA, that uses a con...
research
07/04/2022

FFCNet: Fourier Transform-Based Frequency Learning and Complex Convolutional Network for Colon Disease Classification

Reliable automatic classification of colonoscopy images is of great sign...
research
07/30/2020

Cascaded Non-local Neural Network for Point Cloud Semantic Segmentation

In this paper, we propose a cascaded non-local neural network for point ...
research
03/31/2022

Cross-modal Learning of Graph Representations using Radar Point Cloud for Long-Range Gesture Recognition

Gesture recognition is one of the most intuitive ways of interaction and...
research
06/05/2019

Butterfly Transform: An Efficient FFT Based Neural Architecture Design

In this paper, we introduce the Butterfly Transform (BFT), a light weigh...

Please sign up or login with your details

Forgot password? Click here to reset