Incompleteness of graph convolutional neural networks for points clouds in three dimensions

01/18/2022
by   Sergey N. Pozdnyakov, et al.
0

Graph convolutional neural networks (GCNN) are very popular methods in machine learning and have been applied very successfully to the prediction of the properties of molecules and materials. First-order GCNNs are well known to be incomplete, i.e., there exist graphs that are distinct but appear identical when seen through the lens of the GCNN. More complicated schemes have thus been designed to increase their resolving power. Applications to molecules (and more generally, point clouds), however, add a geometric dimension to the problem. The most straightforward and prevalent approach to construct graph representation for the molecules regards atoms as vertices in a graph and draws a bond between each pair of atoms within a certain preselected cutoff. Bonds can be decorated with the distance between atoms, and the resulting "distance graph convolution NNs" (dGCNN) have empirically demonstrated excellent resolving power and are widely used in chemical ML. Here we show that even for the restricted case of graphs induced by 3D atom clouds dGCNNs are not complete. We construct pairs of distinct point clouds that generate graphs that, for any cutoff radius, are equivalent based on a first-order Weisfeiler-Lehman test. This class of degenerate structures includes chemically-plausible configurations, setting an ultimate limit to the expressive power of some of the well-established GCNN architectures for atomistic machine learning. Models that explicitly use angular information in the description of atomic environments can resolve these degeneracies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/11/2019

Joint Learning of Graph Representation and Node Features in Graph Convolutional Neural Networks

Graph Convolutional Neural Networks (GCNNs) extend classical CNNs to gra...
research
05/24/2019

Likelihood-Free Inference and Generation of Molecular Graphs

Recent methods for generating novel molecules use graph representations ...
research
05/30/2023

Smooth, exact rotational symmetrization for deep learning on point clouds

Point clouds are versatile representations of 3D objects and have found ...
research
03/22/2023

Three iterations of (d-1)-WL test distinguish non isometric clouds of d-dimensional points

The Weisfeiler–Lehman (WL) test is a fundamental iterative algorithm for...
research
12/01/2018

Discovering Molecular Functional Groups Using Graph Convolutional Neural Networks

Functional groups (FGs) serve as a foundation for analyzing chemical pro...
research
07/22/2021

Size doesn't matter: predicting physico- or biochemical properties based on dozens of molecules

The use of machine learning in chemistry has become a common practice. A...
research
07/25/2019

Graph Informer Networks for Molecules

In machine learning, chemical molecules are often represented by sparse ...

Please sign up or login with your details

Forgot password? Click here to reset