Assessing the Difficulty of Classifying ConceptNet Relations in a Multi-Label Classification Setting

05/14/2019
by   Maria Becker, et al.
0

Commonsense knowledge relations are crucial for advanced NLU tasks. We examine the learnability of such relations as represented in CONCEPTNET, taking into account their specific properties, which can make relation classification difficult: a given concept pair can be linked by multiple relation types, and relations can have multi-word arguments of diverse semantic types. We explore a neural open world multi-label classification approach that focuses on the evaluation of classification accuracy for individual relations. Based on an in-depth study of the specific properties of the CONCEPTNET resource, we investigate the impact of different relation representations and model variations. Our analysis reveals that the complexity of argument types and relation ambiguity are the most important challenges to address. We design a customized evaluation method to address the incompleteness of the resource that can be expanded in future work.

READ FULL TEXT
research
12/20/2022

Document-level Relation Extraction with Relation Correlations

Document-level relation extraction faces two overlooked challenges: long...
research
05/01/2022

None Class Ranking Loss for Document-Level Relation Extraction

Document-level relation extraction (RE) aims at extracting relations amo...
research
07/16/2019

Relation Network for Multi-label Aerial Image Classification

Multi-label classification plays a momentous role in perceiving intricat...
research
05/31/2018

Multi-Label Transfer Learning for Semantic Similarity

The semantic relations between two short texts can be defined in multipl...
research
07/13/2021

Multi-Scale Label Relation Learning for Multi-Label Classification Using 1-Dimensional Convolutional Neural Networks

We present Multi-Scale Label Dependence Relation Networks (MSDN), a nove...
research
07/21/2020

Compositional equivalences based on Open pNets

This article defines bisimulation relations for the comparison of system...
research
10/16/2015

Normalization of Relative and Incomplete Temporal Expressions in Clinical Narratives

We analyze the RI-TIMEXes in temporally annotated corpora and propose tw...

Please sign up or login with your details

Forgot password? Click here to reset