How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?

05/02/2023
by   Xin Xu, et al.
0

Scaling language models have revolutionized widespread NLP tasks, yet little comprehensively explored few-shot relation extraction with large language models. In this paper, we investigate principal methodologies, in-context learning and data generation, for few-shot relation extraction via GPT-3.5 through exhaustive experiments. To enhance few-shot performance, we further propose task-related instructions and schema-constrained data generation. We observe that in-context learning can achieve performance on par with previous prompt learning approaches, and data generation with the large language model can boost previous solutions to obtain new state-of-the-art few-shot results on four widely-studied relation extraction datasets. We hope our work can inspire future research for the capabilities of large language models in few-shot relation extraction. Code is available in https://github.com/zjunlp/DeepKE/tree/main/example/llm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/14/2020

Unsupervised Relation Extraction from Language Models using Constrained Cloze Completion

We show that state-of-the-art self-supervised language models can be rea...
research
05/04/2022

Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning

Pre-trained language models have contributed significantly to relation e...
research
10/28/2022

DORE: Document Ordered Relation Extraction based on Generative Framework

In recent years, there is a surge of generation-based information extrac...
research
03/25/2019

Connecting Language and Knowledge with Heterogeneous Representations for Neural Relation Extraction

Knowledge Bases (KBs) require constant up-dating to reflect changes to t...
research
09/16/2021

Reframing Instructional Prompts to GPTk's Language

How can model designers turn task instructions into effective prompts fo...
research
05/08/2023

Revisiting Relation Extraction in the era of Large Language Models

Relation extraction (RE) is the core NLP task of inferring semantic rela...
research
07/07/2023

Linguistic representations for fewer-shot relation extraction across domains

Recent work has demonstrated the positive impact of incorporating lingui...

Please sign up or login with your details

Forgot password? Click here to reset