A Meta-Learning Approach for Graph Representation Learning in Multi-Task Settings

12/12/2020
by   Davide Buffelli, et al.
0

Graph Neural Networks (GNNs) are a framework for graph representation learning, where a model learns to generate low dimensional node embeddings that encapsulate structural and feature-related information. GNNs are usually trained in an end-to-end fashion, leading to highly specialized node embeddings. However, generating node embeddings that can be used to perform multiple tasks (with performance comparable to single-task models) is an open problem. We propose a novel meta-learning strategy capable of producing multi-task node embeddings. Our method avoids the difficulties arising when learning to perform multiple tasks concurrently by, instead, learning to quickly (i.e. with a few steps of gradient descent) adapt to multiple tasks singularly. We show that the embeddings produced by our method can be used to perform multiple tasks with comparable or higher performance than classically trained models. Our method is model-agnostic and task-agnostic, thus applicable to a wide variety of multi-task domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/10/2022

Graph Representation Learning for Multi-Task Settings: a Meta-Learning Approach

Graph Neural Networks (GNNs) have become the state-of-the-art method for...
research
10/05/2022

Multi-task Self-supervised Graph Neural Networks Enable Stronger Task Generalization

Self-supervised learning (SSL) for graph neural networks (GNNs) has attr...
research
12/28/2022

PersonaSAGE: A Multi-Persona Graph Neural Network

Graph Neural Networks (GNNs) have become increasingly important in recen...
research
03/18/2020

Few-Shot Graph Classification with Model Agnostic Meta-Learning

Graph classification aims to perform accurate information extraction and...
research
04/20/2023

Learning Cellular Coverage from Real Network Configurations using GNNs

Cellular coverage quality estimation has been a critical task for self-o...
research
08/03/2023

SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learning

Textual graphs (TGs) are graphs whose nodes correspond to text (sentence...
research
05/27/2019

MCNE: An End-to-End Framework for Learning Multiple Conditional Network Representations of Social Network

Recently, the Network Representation Learning (NRL) techniques, which re...

Please sign up or login with your details

Forgot password? Click here to reset