Clustering articles based on semantic similarity

02/16/2017
by   Shenghui Wang, et al.
0

Document clustering is generally the first step for topic identification. Since many clustering methods operate on the similarities between documents, it is important to build representations of these documents which keep their semantics as much as possible and are also suitable for efficient similarity calculation. The metadata of articles in the Astro dataset contribute to a semantic matrix, which uses a vector space to capture the semantics of entities derived from these articles and consequently supports the contextual exploration of these entities in LittleAriadne. However, this semantic matrix does not allow to calculate similarities between articles directly. In this paper, we will describe in detail how we build a semantic representation for an article from the entities that are associated with it. Base on such semantic representations of articles, we apply two standard clustering methods, K-Means and the Louvain community detection algorithm, which leads to our two clustering solutions labelled as OCLC-31 (standing for K-Means) and OCLC-Louvain (standing for Louvain). In this paper, we will give the implementation details and a basic comparison with other clustering solutions that are reported in this special issue.

READ FULL TEXT
research
02/27/2017

Contextualization of topics: Browsing through the universe of bibliographic information

This paper describes how semantic indexing can help to generate a contex...
research
11/30/2017

Calculating Semantic Similarity between Academic Articles using Topic Event and Ontology

Determining semantic similarity between academic documents is crucial to...
research
07/20/2018

Semantic Document Clustering on Named Entity Features

Keyword-based information processing has limitations due to simple treat...
research
06/30/2023

A Massive Scale Semantic Similarity Dataset of Historical English

A diversity of tasks use language models trained on semantic similarity ...
research
08/17/2012

Content-based Text Categorization using Wikitology

A major computational burden, while performing document clustering, is t...
research
06/03/2021

A protocol to gather, characterize and analyze incoming citations of retracted articles

In this article, we present a methodology which takes as input a collect...

Please sign up or login with your details

Forgot password? Click here to reset