Zero-shot Triplet Extraction by Template Infilling

12/21/2022
by   Bosung Kim, et al.
0

Triplet extraction aims to extract entities and their corresponding relations in unstructured text. Most existing methods train an extraction model on high-quality training data, and hence are incapable of extracting relations that were not observed during training. Generalizing the model to unseen relations typically requires fine-tuning on synthetic training data which is often noisy and unreliable. In this paper, we argue that reducing triplet extraction to a template filling task over a pre-trained language model can equip the model with zero-shot learning capabilities and enable it to leverage the implicit knowledge in the language model. Embodying these ideas, we propose a novel framework, ZETT (ZEro-shot Triplet extraction by Template infilling), that is based on end-to-end generative transformers. Our experiments show that without any data augmentation or pipeline systems, ZETT can outperform previous state-of-the-art models with 25 more robust in detecting entities and can be incorporated with automatically generated templates for relations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/17/2022

RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction

Despite the importance of relation extraction in building and representi...
research
11/26/2022

PCRED: Zero-shot Relation Triplet Extraction with Potential Candidate Relation Selection and Entity Boundary Detection

Zero-shot relation triplet extraction (ZeroRTE) aims to extract relation...
research
05/12/2022

Zero-shot Code-Mixed Offensive Span Identification through Rationale Extraction

This paper investigates the effectiveness of sentence-level transformers...
research
05/24/2023

A Monte Carlo Language Model Pipeline for Zero-Shot Sociopolitical Event Extraction

We consider dyadic zero-shot event extraction (EE) to identify actions b...
research
01/10/2023

API Entity and Relation Joint Extraction from Text via Dynamic Prompt-tuned Language Model

Extraction of Application Programming Interfaces (APIs) and their semant...
research
04/10/2021

ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learning

While relation extraction is an essential task in knowledge acquisition ...
research
12/16/2021

UniREx: A Unified Learning Framework for Language Model Rationale Extraction

An extractive rationale explains a language model's (LM's) prediction on...

Please sign up or login with your details

Forgot password? Click here to reset