DeepAI
Log In Sign Up

Supertagging Combinatory Categorial Grammar with Attentive Graph Convolutional Networks

10/13/2020
by   Yuanhe Tian, et al.
0

Supertagging is conventionally regarded as an important task for combinatory categorial grammar (CCG) parsing, where effective modeling of contextual information is highly important to this task. However, existing studies have made limited efforts to leverage contextual features except for applying powerful encoders (e.g., bi-LSTM). In this paper, we propose attentive graph convolutional networks to enhance neural CCG supertagging through a novel solution of leveraging contextual information. Specifically, we build the graph from chunks (n-grams) extracted from a lexicon and apply attention over the graph, so that different word pairs from the contexts within and across chunks are weighted in the model and facilitate the supertagging accordingly. The experiments performed on the CCGbank demonstrate that our approach outperforms all previous studies in terms of both supertagging and parsing. Further analyses illustrate the effectiveness of each component in our approach to discriminatively learn from word pairs to enhance CCG supertagging.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/24/2019

Focusing and Diffusion: Bidirectional Attentive Graph Convolutional Networks for Skeleton-based Action Recognition

A collection of approaches based on graph convolutional networks have pr...
11/26/2020

Encoding Syntactic Constituency Paths for Frame-Semantic Parsing with Graph Convolutional Networks

We study the problem of integrating syntactic information from constitue...
04/12/2020

VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification

Much progress has been made recently on text classification with methods...
05/08/2021

Business Entity Matching with Siamese Graph Convolutional Networks

Data integration has been studied extensively for decades and approached...
06/16/2020

Relational Fusion Networks: Graph Convolutional Networks for Road Networks

The application of machine learning techniques in the setting of road ne...
01/25/2022

Main Product Detection with Graph Networks for Fashion

Computer vision has established a foothold in the online fashion retail ...
10/14/2021

A Dual-Attention Neural Network for Pun Location and Using Pun-Gloss Pairs for Interpretation

Pun location is to identify the punning word (usually a word or a phrase...