DAGformer: Directed Acyclic Graph Transformer

10/24/2022
by   Yuankai Luo, et al.
0

In many fields, such as natural language processing and computer vision, the Transformer architecture has become the standard. Recently, the Transformer architecture has also attracted a growing amount of interest in graph representation learning since it naturally overcomes some graph neural network (GNNs) restrictions. In this work, we focus on a special yet widely used class of graphs-DAGs. We propose the directed acyclic graph Transformer, DAGformer, a Transformer architecture that processes information according to the reachability relation defined by the partial order. DAGformer is simple and flexible, allowing it to be used with various transformer-based models. We show that our architecture achieves state-of-the-art performance on representative DAG datasets, outperforming all previous approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/20/2021

Directed Acyclic Graph Neural Networks

Graph-structured data ubiquitously appears in science and engineering. G...
research
03/28/2023

Transformer and Snowball Graph Convolution Learning for Biomedical Graph Classification

Graph or network has been widely used for describing and modeling comple...
research
12/17/2020

A Generalization of Transformer Networks to Graphs

We propose a generalization of transformer neural network architecture f...
research
06/29/2022

Deformable Graph Transformer

Transformer-based models have been widely used and achieved state-of-the...
research
02/17/2022

Transformer for Graphs: An Overview from Architecture Perspective

Recently, Transformer model, which has achieved great success in many ar...
research
11/23/2019

A Transformer-based approach to Irony and Sarcasm detection

Figurative Language (FL) seems ubiquitous in all social-media discussion...
research
03/24/2022

Keypoints Tracking via Transformer Networks

In this thesis, we propose a pioneering work on sparse keypoints trackin...

Please sign up or login with your details

Forgot password? Click here to reset