Universal Graph Continual Learning

08/27/2023
by   Thanh Duc Hoang, et al.
0

We address catastrophic forgetting issues in graph learning as incoming data transits from one to another graph distribution. Whereas prior studies primarily tackle one setting of graph continual learning such as incremental node classification, we focus on a universal approach wherein each data point in a task can be a node or a graph, and the task varies from node to graph classification. We propose a novel method that enables graph neural networks to excel in this universal setting. Our approach perseveres knowledge about past tasks through a rehearsal mechanism that maintains local and global structure consistency across the graphs. We benchmark our method against various continual learning baselines in real-world graph datasets and achieve significant improvement in average performance and forgetting across tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/21/2021

Wide Neural Networks Forget Less Catastrophically

A growing body of research in continual learning is devoted to overcomin...
research
12/10/2020

Overcoming Catastrophic Forgetting in Graph Neural Networks

Catastrophic forgetting refers to the tendency that a neural network "fo...
research
01/28/2023

Continual Graph Learning: A Survey

Research on continual learning (CL) mainly focuses on data represented i...
research
11/26/2022

BeGin: Extensive Benchmark Scenarios and An Easy-to-use Framework for Graph Continual Learning

Continual Learning (CL) is the process of learning ceaselessly a sequenc...
research
05/15/2023

Continual Multimodal Knowledge Graph Construction

Multimodal Knowledge Graph Construction (MKGC) involves creating structu...
research
07/18/2023

HAT-CL: A Hard-Attention-to-the-Task PyTorch Library for Continual Learning

Catastrophic forgetting, the phenomenon in which a neural network loses ...
research
09/23/2020

Streaming Graph Neural Networks via Continual Learning

Graph neural networks (GNNs) have achieved strong performance in various...

Please sign up or login with your details

Forgot password? Click here to reset