About Evaluation of F1 Score for RECENT Relation Extraction System

05/16/2023
by   Michał Olek, et al.
0

This document contains a discussion of the F1 score evaluation used in the article 'Relation Classification with Entity Type Restriction' by Shengfei Lyu, Huanhuan Chen published on Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. The authors created a system named RECENT and claim it achieves (then) a new state-of-the-art result 75.2 (previous 74.8) on the TACRED dataset, while after correcting errors and reevaluation the final result is 65.16

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/20/2023

A Two-step Approach for Handling Zero-Cardinality in Relation Extraction

Relation tuple extraction from text is an important task for building kn...
research
06/30/2023

iMETRE: Incorporating Markers of Entity Types for Relation Extraction

Sentence-level relation extraction (RE) aims to identify the relationshi...
research
01/26/2023

Task formulation for Extracting Social Determinants of Health from Clinical Narratives

Objective: The 2022 n2c2 NLP Challenge posed identification of social de...
research
04/16/2021

Re-TACRED: Addressing Shortcomings of the TACRED Dataset

TACRED is one of the largest and most widely used sentence-level relatio...
research
05/03/2019

Time-sync Video Tag Extraction Using Semantic Association Graph

Time-sync comments reveal a new way of extracting the online video tags....
research
06/01/2023

End-to-End Document Classification and Key Information Extraction using Assignment Optimization

We propose end-to-end document classification and key information extrac...
research
10/04/2018

Italian Event Detection Goes Deep Learning

This paper reports on a set of experiments with different word embedding...

Please sign up or login with your details

Forgot password? Click here to reset