Advancing Relation Extraction through Language Probing with Exemplars from Set Co-Expansion

08/18/2023
by   Yerong Li, et al.
0

Relation Extraction (RE) is a pivotal task in automatically extracting structured information from unstructured text. In this paper, we present a multi-faceted approach that integrates representative examples and through co-set expansion. The primary goal of our method is to enhance relation classification accuracy and mitigating confusion between contrastive classes. Our approach begins by seeding each relationship class with representative examples. Subsequently, our co-set expansion algorithm enriches training objectives by incorporating similarity measures between target pairs and representative pairs from the target class. Moreover, the co-set expansion process involves a class ranking procedure that takes into account exemplars from contrastive classes. Contextual details encompassing relation mentions are harnessed via context-free Hearst patterns to ascertain contextual similarity. Empirical evaluation demonstrates the efficacy of our co-set expansion approach, resulting in a significant enhancement of relation classification performance. Our method achieves an observed margin of at least 1 percent improvement in accuracy in most settings, on top of existing fine-tuning approaches. To further refine our approach, we conduct an in-depth analysis that focuses on tuning contrastive examples. This strategic selection and tuning effectively reduce confusion between classes sharing similarities, leading to a more precise classification process. Experimental results underscore the effectiveness of our proposed framework for relation extraction. The synergy between co-set expansion and context-aware prompt tuning substantially contributes to improved classification accuracy. Furthermore, the reduction in confusion between contrastive classes through contrastive examples tuning validates the robustness and reliability of our method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2022

Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction

Relation extraction is a core problem for natural language processing in...
research
05/04/2022

HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction

Unsupervised relation extraction aims to extract the relationship betwee...
research
07/29/2020

Improving Performance of Relation Extraction Algorithm via Leveled Adversarial PCNN and Database Expansion

This study introduces database expansion using the Minimum Description L...
research
05/25/2022

Fine-grained Contrastive Learning for Relation Extraction

Recent relation extraction (RE) works have shown encouraging improvement...
research
12/29/2022

Reviewing Labels: Label Graph Network with Top-k Prediction Set for Relation Extraction

The typical way for relation extraction is fine-tuning large pre-trained...
research
06/28/2021

Progressive Class-based Expansion Learning For Image Classification

In this paper, we propose a novel image process scheme called class-base...
research
06/06/2023

Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage

We investigate the role of projection heads, also known as projectors, w...

Please sign up or login with your details

Forgot password? Click here to reset