DeepAI AI Chat
Log In Sign Up

Zero-shot Triplet Extraction by Template Infilling

12/21/2022
by   Bosung Kim, et al.
Megagon Labs
University of California, San Diego
0

Triplet extraction aims to extract entities and their corresponding relations in unstructured text. Most existing methods train an extraction model on high-quality training data, and hence are incapable of extracting relations that were not observed during training. Generalizing the model to unseen relations typically requires fine-tuning on synthetic training data which is often noisy and unreliable. In this paper, we argue that reducing triplet extraction to a template filling task over a pre-trained language model can equip the model with zero-shot learning capabilities and enable it to leverage the implicit knowledge in the language model. Embodying these ideas, we propose a novel framework, ZETT (ZEro-shot Triplet extraction by Template infilling), that is based on end-to-end generative transformers. Our experiments show that without any data augmentation or pipeline systems, ZETT can outperform previous state-of-the-art models with 25 more robust in detecting entities and can be incorporated with automatically generated templates for relations.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/17/2022

RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction

Despite the importance of relation extraction in building and representi...
05/12/2022

Zero-shot Code-Mixed Offensive Span Identification through Rationale Extraction

This paper investigates the effectiveness of sentence-level transformers...
09/30/2022

What Makes Pre-trained Language Models Better Zero/Few-shot Learners?

In this paper, we propose a theoretical framework to explain the efficac...
01/10/2023

API Entity and Relation Joint Extraction from Text via Dynamic Prompt-tuned Language Model

Extraction of Application Programming Interfaces (APIs) and their semant...
03/25/2022

ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations

The current workflow for Information Extraction (IE) analysts involves t...
08/05/2019

Zero-Shot Deep Hashing and Neural Network Based Error Correction for Face Template Protection

In this paper, we present a novel architecture that integrates a deep ha...