A Survey of Graph Prompting Methods: Techniques, Applications, and Challenges

03/13/2023
by   Xuansheng Wu, et al.
0

While deep learning has achieved great success on various tasks, the task-specific model training notoriously relies on a large volume of labeled data. Recently, a new training paradigm of “pre-train, prompt, predict” has been proposed to improve model generalization ability with limited labeled data. The main idea is that, based on a pre-trained model, the prompting function uses a template to augment input samples with indicative context and reformalizes the target task to one of the pre-training tasks. In this survey, we provide a unique review of prompting methods from the graph perspective. Graph data has served as structured knowledge repositories in various systems by explicitly modeling the interaction between entities. Compared with traditional methods, graph prompting functions could induce task-related context and apply templates with structured knowledge. The pre-trained model is then adaptively generalized for future samples. In particular, we introduce the basic concepts of graph prompt learning, organize the existing work of designing graph prompting functions, and describe their applications and challenges to a variety of machine learning problems. This survey attempts to bridge the gap between structured graphs and prompt design to facilitate future methodology development.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2021

Multi network InfoMax: A pre-training method involving graph convolutional networks

Discovering distinct features and their relations from data can help us ...
research
02/15/2018

Cost-Effective Training of Deep CNNs with Active Model Adaptation

Deep convolutional neural networks have achieved great success in variou...
research
03/04/2021

Universal Representation for Code

Learning from source code usually requires a large amount of labeled dat...
research
12/02/2016

Cognitive Deep Machine Can Train Itself

Machine learning is making substantial progress in diverse applications....
research
07/28/2021

Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

This paper surveys and organizes research works in a new paradigm in nat...
research
12/25/2019

Deep Graph Similarity Learning: A Survey

In many domains where data are represented as graphs, learning a similar...
research
05/18/2023

Statistical Foundations of Prior-Data Fitted Networks

Prior-data fitted networks (PFNs) were recently proposed as a new paradi...

Please sign up or login with your details

Forgot password? Click here to reset