Function-words Enhanced Attention Networks for Few-Shot Inverse Relation Classification

04/26/2022
by   Chunliu Dou, et al.
0

The relation classification is to identify semantic relations between two entities in a given text. While existing models perform well for classifying inverse relations with large datasets, their performance is significantly reduced for few-shot learning. In this paper, we propose a function words adaptively enhanced attention framework (FAEA) for few-shot inverse relation classification, in which a hybrid attention model is designed to attend class-related function words based on meta-learning. As the involvement of function words brings in significant intra-class redundancy, an adaptive message passing mechanism is introduced to capture and transfer inter-class differences.We mathematically analyze the negative impact of function words from dot-product measurement, which explains why message passing mechanism effectively reduces the impact. Our experimental results show that FAEA outperforms strong baselines, especially the inverse relation accuracy is improved by 14.33

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2019

Message Passing Attention Networks for Document Understanding

Most graph neural networks can be described in terms of message passing,...
research
08/16/2019

Few-shot Text Classification with Distributional Signatures

In this paper, we explore meta-learning for few-shot text classification...
research
10/21/2020

Learning to Decouple Relations: Few-Shot Relation Classification with Entity-Guided Attention and Confusion-Aware Training

This paper aims to enhance the few-shot relation classification especial...
research
01/23/2021

Neural Relational Inference with Efficient Message Passing Mechanisms

Many complex processes can be viewed as dynamical systems of interacting...
research
02/14/2021

Relation-aware Graph Attention Model With Adaptive Self-adversarial Training

This paper describes an end-to-end solution for the relationship predict...
research
01/10/2021

Adaptive Prototypical Networks with Label Words and Joint Representation Learning for Few-Shot Relation Classification

Relation classification (RC) task is one of fundamental tasks of informa...
research
01/12/2020

Rethinking Class Relations: Absolute-relative Few-shot Learning

The majority of existing few-shot learning describe image relations with...

Please sign up or login with your details

Forgot password? Click here to reset