Benchmarking Graphormer on Large-Scale Molecular Modeling Datasets

03/09/2022
by   Yu Shi, et al.
10

This technical note describes the recent updates of Graphormer, including architecture design modifications, and the adaption to 3D molecular dynamics simulation. With these simple modifications, Graphormer could attain better results on large-scale molecular modeling datasets than the vanilla one, and the performance gain could be consistently obtained on 2D and 3D molecular graph modeling tasks. In addition, we show that with a global receptive field and an adaptive aggregation strategy, Graphormer is more powerful than classic message-passing-based GNNs. Empirically, Graphormer could achieve much less MAE than the originally reported results on the PCQM4M quantum chemistry dataset used in KDD Cup 2021. In the meanwhile, it greatly outperforms the competitors in the recent Open Catalyst Challenge, which is a competition track on NeurIPS 2021 workshop, and aims to model the catalyst-adsorbate reaction system with advanced AI models. All codes could be found at https://github.com/Microsoft/Graphormer.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2022

An Empirical Study of Graphormer on Large-Scale Molecular Modeling Datasets

This technical note describes the recent updates of Graphormer, includin...
research
06/28/2021

LiteGEM: Lite Geometry Enhanced Molecular Representation Learning for Quantum Property Prediction

In this report, we (SuperHelix team) present our solution to KDD Cup 202...
research
06/22/2020

Hierarchical Inter-Message Passing for Learning on Molecular Graphs

We present a hierarchical neural message passing architecture for learni...
research
09/02/2021

Heterogeneous relational message passing networks for molecular dynamics simulations

With many frameworks based on message passing neural networks proposed t...
research
10/28/2020

Forgery Blind Inspection for Detecting Manipulations of Gel Electrophoresis Images

Recently, falsified images have been found in papers involved in researc...
research
05/29/2019

Path-Augmented Graph Transformer Network

Much of the recent work on learning molecular representations has been b...
research
08/24/2020

Optimized routines for event generators in QED-PIC codes

In recent years, the prospects of performing fundamental and applied stu...

Please sign up or login with your details

Forgot password? Click here to reset