Open Relation and Event Type Discovery with Type Abstraction

11/30/2022
by   Sha Li, et al.
0

Conventional closed-world information extraction (IE) approaches rely on human ontologies to define the scope for extraction. As a result, such approaches fall short when applied to new domains. This calls for systems that can automatically infer new types from given corpora, a task which we refer to as type discovery. To tackle this problem, we introduce the idea of type abstraction, where the model is prompted to generalize and name the type. Then we use the similarity between inferred names to induce clusters. Observing that this abstraction-based representation is often complementary to the entity/trigger token representation, we set up these two representations as two views and design our model as a co-training framework. Our experiments on multiple relation extraction and event extraction datasets consistently show the advantage of our type abstraction approach. Code available at https://github.com/raspberryice/type-discovery-abs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/05/2020

Learning from Context or Names? An Empirical Study on Neural Relation Extraction

Neural models have achieved remarkable success on relation extraction (R...
research
07/26/2023

FinTree: Financial Dataset Pretrain Transformer Encoder for Relation Extraction

We present FinTree, Financial Dataset Pretrain Transformer Encoder for R...
research
09/08/2019

Entity. Relation, and Event Extraction with Contextualized Span Representations

We examine the capabilities of a unified, multi-task framework for three...
research
08/16/2021

An Effective System for Multi-format Information Extraction

The multi-format information extraction task in the 2021 Language and In...
research
03/25/2019

Connecting Language and Knowledge with Heterogeneous Representations for Neural Relation Extraction

Knowledge Bases (KBs) require constant up-dating to reflect changes to t...
research
05/04/2022

Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning

Pre-trained language models have contributed significantly to relation e...
research
02/12/2021

Two Training Strategies for Improving Relation Extraction over Universal Graph

This paper explores how the Distantly Supervised Relation Extraction (DS...

Please sign up or login with your details

Forgot password? Click here to reset