Graph Neural Networks for Natural Language Processing: A Survey

06/10/2021
by   Lingfei Wu, et al.
176

Deep learning has become the dominant approach in coping with various tasks in Natural LanguageProcessing (NLP). Although text inputs are typically represented as a sequence of tokens, there isa rich variety of NLP problems that can be best expressed with a graph structure. As a result, thereis a surge of interests in developing new deep learning techniques on graphs for a large numberof NLP tasks. In this survey, we present a comprehensive overview onGraph Neural Networks(GNNs) for Natural Language Processing. We propose a new taxonomy of GNNs for NLP, whichsystematically organizes existing research of GNNs for NLP along three axes: graph construction,graph representation learning, and graph based encoder-decoder models. We further introducea large number of NLP applications that are exploiting the power of GNNs and summarize thecorresponding benchmark datasets, evaluation metrics, and open-source codes. Finally, we discussvarious outstanding challenges for making the full use of GNNs for NLP as well as future researchdirections. To the best of our knowledge, this is the first comprehensive overview of Graph NeuralNetworks for Natural Language Processing.

READ FULL TEXT

page 3

page 18

page 20

page 22

03/18/2020

Pre-trained Models for Natural Language Processing: A Survey

Recently, the emergence of pre-trained models (PTMs) has brought natural...
08/24/2021

Graph Neural Networks: Methods, Applications, and Opportunities

In the last decade or so, we have witnessed deep learning reinvigorating...
04/11/2022

A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challenges

Legal judgment prediction (LJP) applies Natural Language Processing (NLP...
08/22/2022

Survey of NLP in Pharmacology: Methodology, Tasks, Resources, Knowledge, and Tools

Natural language processing (NLP) is an area of artificial intelligence ...
11/05/2020

Semantic and Relational Spaces in Science of Science: Deep Learning Models for Article Vectorisation

Over the last century, we observe a steady and exponentially growth of s...
12/16/2021

CLICKER: A Computational LInguistics Classification Scheme for Educational Resources

A classification scheme of a scientific subject gives an overview of its...
07/25/2020

Constructing a Testbed for Psychometric Natural Language Processing

Psychometric measures of ability, attitudes, perceptions, and beliefs ar...

Code Repositories

graph4nlp_demo

This repo is to present various code demos on how to use our Graph4NLP library.


view repo