Layer-refined Graph Convolutional Networks for Recommendation

07/22/2022
by   Xin Zhou, et al.
0

Recommendation models utilizing Graph Convolutional Networks (GCNs) have achieved state-of-the-art performance, as they can integrate both the node information and the topological structure of the user-item interaction graph. However, these GCN-based recommendation models not only suffer from over-smoothing when stacking too many layers but also bear performance degeneration resulting from the existence of noise in user-item interactions. In this paper, we first identify a recommendation dilemma of over-smoothing and solution collapsing in current GCN-based models. Specifically, these models usually aggregate all layer embeddings for node updating and achieve their best recommendation performance within a few layers because of over-smoothing. Conversely, if we place learnable weights on layer embeddings for node updating, the weight space will always collapse to a fixed point, at which the weighting of the ego layer almost holds all. We propose a layer-refined GCN model, dubbed LayerGCN, that refines layer representations during information propagation and node updating of GCN. Moreover, previous GCN-based recommendation models aggregate all incoming information from neighbors without distinguishing the noise nodes, which deteriorates the recommendation performance. Our model further prunes the edges of the user-item interaction graph following a degree-sensitive probability instead of the uniform distribution. Experimental results show that the proposed model outperforms the state-of-the-art models significantly on four public datasets with fast training convergence. The implementation code of the proposed method is available at https://github.com/enoche/ImRec.

READ FULL TEXT

page 1

page 10

research
01/28/2020

Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach

Graph Convolutional Networks (GCNs) are state-of-the-art graph based rep...
research
11/03/2021

GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedback

Reorganizing implicit feedback of users as a user-item interaction graph...
research
05/27/2019

STAR-GCN: Stacked and Reconstructed Graph Convolutional Networks for Recommender Systems

We propose a new STAcked and Reconstructed Graph Convolutional Networks ...
research
04/14/2023

AGNN: Alternating Graph-Regularized Neural Networks to Alleviate Over-Smoothing

Graph Convolutional Network (GCN) with the powerful capacity to explore ...
research
04/09/2020

Graph Highway Networks

Graph Convolution Networks (GCN) are widely used in learning graph repre...
research
09/28/2021

IGLU: Efficient GCN Training via Lazy Updates

Graph Convolution Networks (GCN) are used in numerous settings involving...
research
02/19/2021

Interest-aware Message-Passing GCN for Recommendation

Graph Convolution Networks (GCNs) manifest great potential in recommenda...

Please sign up or login with your details

Forgot password? Click here to reset