Learning Robust Representations with Graph Denoising Policy Network

10/04/2019
by   Lu Wang, et al.
21

Graph representation learning, aiming to learn low-dimensional representations which capture the geometric dependencies between nodes in the original graph, has gained increasing popularity in a variety of graph analysis tasks, including node classification and link prediction. Existing representation learning methods based on graph neural networks and their variants rely on the aggregation of neighborhood information, which makes it sensitive to noises in the graph. In this paper, we propose Graph Denoising Policy Network (short for GDPNet) to learn robust representations from noisy graph data through reinforcement learning. GDPNet first selects signal neighborhoods for each node, and then aggregates the information from the selected neighborhoods to learn node representations for the down-stream tasks. Specifically, in the signal neighborhood selection phase, GDPNet optimizes the neighborhood for each target node by formulating the process of removing noisy neighborhoods as a Markov decision process and learning a policy with task-specific rewards received from the representation learning phase. In the representation learning phase, GDPNet aggregates features from signal neighbors to generate node representations for down-stream tasks, and provides task-specific rewards to the signal neighbor selection phase. These two phases are jointly trained to select optimal sets of neighbors for target nodes with maximum cumulative task-specific rewards, and to learn robust representations for nodes. Experimental results on node classification task demonstrate the effectiveness of GDNet, outperforming the state-of-the-art graph representation learning methods on several well-studied datasets. Additionally, GDPNet is mathematically equivalent to solving the submodular maximizing problem, which theoretically guarantees the best approximation to the optimal solution with GDPNet.

READ FULL TEXT
research
11/05/2019

GraphAIR: Graph Representation Learning with Neighborhood Aggregation and Interaction

Graph representation learning is of paramount importance for a variety o...
research
04/20/2023

Improving Graph Neural Networks on Multi-node Tasks with Labeling Tricks

In this paper, we provide a theory of using graph neural networks (GNNs)...
research
11/08/2021

Inferential SIR-GN: Scalable Graph Representation Learning

Graph representation learning methods generate numerical vector represen...
research
05/24/2021

Heterogeneous Graph Representation Learning with Relation Awareness

Representation learning on heterogeneous graphs aims to obtain meaningfu...
research
12/29/2021

GPS: A Policy-driven Sampling Approach for Graph Representation Learning

Graph representation learning has drawn increasing attention in recent y...
research
04/29/2020

Deep Reinforcement Learning with Graph-based State Representations

Deep RL approaches build much of their success on the ability of the dee...
research
07/04/2023

Learning ECG signal features without backpropagation

Representation learning has become a crucial area of research in machine...

Please sign up or login with your details

Forgot password? Click here to reset