End-to-End NLP Knowledge Graph Construction

06/02/2021
by   Ishani Mondal, et al.
0

This paper studies the end-to-end construction of an NLP Knowledge Graph (KG) from scientific papers. We focus on extracting four types of relations: evaluatedOn between tasks and datasets, evaluatedBy between tasks and evaluation metrics, as well as coreferent and related relations between the same type of entities. For instance, F1-score is coreferent with F-measure. We introduce novel methods for each of these relation types and apply our final framework (SciNLP-KG) to 30,000 NLP papers from ACL Anthology to build a large-scale KG, which can facilitate automatically constructing scientific leaderboards for the NLP community. The results of our experiments indicate that the resulting KG contains high-quality information.

READ FULL TEXT
research
06/21/2019

Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Construction

While the fast-paced inception of novel tasks and new datasets helps fos...
research
01/25/2021

TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics

Tasks, Datasets and Evaluation Metrics are important concepts for unders...
research
08/29/2018

Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction

We introduce a multi-task setup of identifying and classifying entities,...
research
05/06/2018

Construction of the Literature Graph in Semantic Scholar

We describe a deployed scalable system for organizing published scientif...
research
05/08/2020

Building a PubMed knowledge graph

PubMed is an essential resource for the medical domain, but useful conce...
research
12/14/2018

Information Extraction from Scientific Literature for Method Recommendation

As a research community grows, more and more papers are published each y...
research
04/04/2021

KnowGraph@IITK at SemEval-2021 Task 11: Building KnowledgeGraph for NLP Research

Research in Natural Language Processing is making rapid advances, result...

Please sign up or login with your details

Forgot password? Click here to reset