Can we assess research using open scientific knowledge graphs? A case study within the Italian National Scientific Qualification

05/18/2021
by   Federica Bologna, et al.
0

The need for open scientific knowledge graphs is ever increasing. While there are large repositories of open access articles and free publication indexes, there are still few free knowledge graphs exposing citation networks, and often their coverage is partial. Consequently, most evaluation processes based on citation counts rely on commercial citation databases. Things are changing thanks to the Initiative for Open Citations (I4OC, https://i4oc.org) and the Initiative for Open Abstracts (I4OA, https://i4oa.org), whose goal is to campaign for scholarly publishers to open the reference lists and the other metadata of their articles. This paper investigates the growth of the open bibliographic metadata and open citations in two scientific knowledge graphs, OpenCitations' COCI and Crossref, with an experiment on the Italian National Scientific Qualification (NSQ), the National process for University Professor qualification which uses data from commercial indexes. We simulated the procedure by only using such open data and explored similarities and differences with the official results. The outcomes of the experiment show that the amount of open bibliographic metadata and open citation data currently available in the two scientific knowledge graphs adopted is not yet enough for obtaining results similar to those provided using commercial databases.

READ FULL TEXT

Authors

page 1

page 10

page 11

page 12

page 13

page 14

02/08/2019

Open data to evaluate academic researchers: an experiment with the Italian Scientific Habilitation

The need for scholarly open data is ever increasing. While there are lar...
04/22/2022

From Books to Knowledge Graphs

The digital transformation of the scientific publishing industry has led...
10/05/2021

Open bibliographic data and the Italian National Scientific Qualification: measuring coverage of academic fields

The importance of open bibliographic repositories is widely accepted by ...
06/08/2021

A tipping point for open citation data

Open citation data can improve the transparency and robustness of scient...
05/23/2017

Contextualizing Citations for Scientific Summarization using Word Embeddings and Domain Knowledge

Citation texts are sometimes not very informative or in some cases inacc...
08/14/2020

Challenges of Linking Organizational Information in Open Government Data to Knowledge Graphs

Open Government Data (OGD) is being published by various public administ...
11/22/2021

Identifying and correcting invalid citations due to DOI errors in Crossref data

This work aims to identify classes of DOI mistakes by analysing the open...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.