Smooth, exact rotational symmetrization for deep learning on point clouds

05/30/2023
by   Sergey N. Pozdnyakov, et al.
0

Point clouds are versatile representations of 3D objects and have found widespread application in science and engineering. Many successful deep-learning models have been proposed that use them as input. Some application domains require incorporating exactly physical constraints, including chemical and materials modeling which we focus on in this paper. These constraints include smoothness, and symmetry with respect to translations, rotations, and permutations of identical particles. Most existing architectures in other domains do not fulfill simultaneously all of these requirements and thus are not applicable to atomic-scale simulations. Many of them, however, can be straightforwardly made to incorporate all the physical constraints except for rotational symmetry. We propose a general symmetrization protocol that adds rotational equivariance to any given model while preserving all the other constraints. As a demonstration of the potential of this idea, we introduce the Point Edge Transformer (PET) architecture, which is not intrinsically equivariant but achieves state-of-the-art performance on several benchmark datasets of molecules and solids. A-posteriori application of our general protocol makes PET exactly equivariant, with minimal changes to its accuracy. By alleviating the need to explicitly incorporate rotational symmetry within the model, our method bridges the gap between the approaches used in different communities, and simplifies the design of deep-learning schemes for chemical and materials modeling.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/19/2021

Learning point embedding for 3D data processing

Among 2D convolutional networks on point clouds, point-based approaches ...
research
01/18/2022

Incompleteness of graph convolutional neural networks for points clouds in three dimensions

Graph convolutional neural networks (GCNN) are very popular methods in m...
research
02/28/2023

Completeness of Atomic Structure Representations

Achieving a complete and symmetric description of a group of point parti...
research
06/26/2017

SchNet: A continuous-filter convolutional neural network for modeling quantum interactions

Deep learning has the potential to revolutionize quantum chemistry as it...
research
04/04/2023

Equivariant Networks for Porous Crystalline Materials

Efficiently predicting properties of porous crystalline materials has gr...
research
03/26/2020

Representations of molecules and materials for interpolation of quantum-mechanical simulations via machine learning

Computational study of molecules and materials from first principles is ...

Please sign up or login with your details

Forgot password? Click here to reset