DeepAI AI Chat
Log In Sign Up

OntoSeg: a Novel Approach to Text Segmentation using Ontological Similarity

11/26/2015
by   Mostafa Bayomi, et al.
0

Text segmentation (TS) aims at dividing long text into coherent segments which reflect the subtopic structure of the text. It is beneficial to many natural language processing tasks, such as Information Retrieval (IR) and document summarisation. Current approaches to text segmentation are similar in that they all use word-frequency metrics to measure the similarity between two regions of text, so that a document is segmented based on the lexical cohesion between its words. Various NLP tasks are now moving towards the semantic web and ontologies, such as ontology-based IR systems, to capture the conceptualizations associated with user needs and contents. Text segmentation based on lexical cohesion between words is hence not sufficient anymore for such tasks. This paper proposes OntoSeg, a novel approach to text segmentation based on the ontological similarity between text blocks. The proposed method uses ontological similarity to explore conceptual relations between text segments and a Hierarchical Agglomerative Clustering (HAC) algorithm to represent the text as a tree-like hierarchy that is conceptually structured. The rich structure of the created tree further allows the segmentation of text in a linear fashion at various levels of granularity. The proposed method was evaluated on a wellknown dataset, and the results show that using ontological similarity in text segmentation is very promising. Also we enhance the proposed method by combining ontological similarity with lexical similarity and the results show an enhancement of the segmentation quality.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/05/2017

Rhetorical relations for information retrieval

Typically, every part in most coherent text has some plausible reason fo...
02/17/2018

Can Network Embedding of Distributional Thesaurus be Combined with Word Vectors for Better Representation?

Distributed representations of words learned from text have proved to be...
12/29/2011

Document Clustering based on Topic Maps

Importance of document clustering is now widely acknowledged by research...
03/25/2018

Text Segmentation as a Supervised Learning Task

Text segmentation, the task of dividing a document into contiguous segme...
02/27/2017

A Knowledge-Based Approach to Word Sense Disambiguation by distributional selection and semantic features

Word sense disambiguation improves many Natural Language Processing (NLP...
06/22/2020

Exploiting Non-Taxonomic Relations for Measuring Semantic Similarity and Relatedness in WordNet

Various applications in the areas of computational linguistics and artif...
07/28/2014

A Fast Hierarchical Method for Multi-script and Arbitrary Oriented Scene Text Extraction

Typography and layout lead to the hierarchical organisation of text in w...