A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution

04/04/2021
by   Tuan Lai, et al.
0

Event coreference resolution is an important research problem with many applications. Despite the recent remarkable success of pretrained language models, we argue that it is still highly beneficial to utilize symbolic features for the task. However, as the input for coreference resolution typically comes from upstream components in the information extraction pipeline, the automatically extracted symbolic features can be noisy and contain errors. Also, depending on the specific context, some features can be more informative than others. Motivated by these observations, we propose a novel context-dependent gated module to adaptively control the information flows from the input symbolic features. Combined with a simple noisy training method, our best models achieve state-of-the-art results on two datasets: ACE 2005 and KBP 2016.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/17/2020

End-to-End Neural Event Coreference Resolution

Traditional event coreference systems usually rely on pipeline framework...
research
12/16/2022

The Impact of Symbolic Representations on In-context Learning for Few-shot Reasoning

Pre-trained language models (LMs) have shown remarkable reasoning perfor...
research
10/22/2020

Neural-Symbolic Integration: A Compositional Perspective

Despite significant progress in the development of neural-symbolic frame...
research
02/15/2021

Within-Document Event Coreference with BERT-Based Contextualized Representations

Event coreference continues to be a challenging problem in information e...
research
08/27/2023

Symbolic and Language Agnostic Large Language Models

We argue that the relative success of large language models (LLMs) is no...
research
09/12/2023

Stochastic LLMs do not Understand Language: Towards Symbolic, Explainable and Ontologically Based LLMs

In our opinion the exuberance surrounding the relative success of data-d...
research
11/01/2022

Clustering-Based Approaches for Symbolic Knowledge Extraction

Opaque models belonging to the machine learning world are ever more expl...

Please sign up or login with your details

Forgot password? Click here to reset