Learning Concept Hierarchies from Text Corpora using Formal Concept Analysis

09/09/2011
by   P. Cimiano, et al.
0

We present a novel approach to the automatic acquisition of taxonomies or concept hierarchies from a text corpus. The approach is based on Formal Concept Analysis (FCA), a method mainly used for the analysis of data, i.e. for investigating and processing explicitly given information. We follow Harris distributional hypothesis and model the context of a certain term as a vector representing syntactic dependencies which are automatically acquired from the text corpus with a linguistic parser. On the basis of this context information, FCA produces a lattice that we convert into a special kind of partial order constituting a concept hierarchy. The approach is evaluated by comparing the resulting concept hierarchies with hand-crafted taxonomies for two domains: tourism and finance. We also directly compare our approach with hierarchical agglomerative clustering as well as with Bi-Section-KMeans as an instance of a divisive clustering algorithm. Furthermore, we investigate the impact of using different measures weighting the contribution of each attribute as well as of applying a particular smoothing technique to cope with data sparseness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2021

Formal context reduction in deriving concept hierarchies from corpora using adaptive evolutionary clustering algorithm star

It is beneficial to automate the process of deriving concept hierarchies...
research
08/31/2021

Artificial Intelligence Algorithms for Natural Language Processing and the Semantic Web Ontology Learning

Evolutionary clustering algorithms have considered as the most popular a...
research
06/21/2021

Attribute Selection using Contranominal Scales

Formal Concept Analysis (FCA) allows to analyze binary data by deriving ...
research
03/06/2019

Incremental Computation of Concept Diagrams

Suppose a formal context K=(G,M,I) is given, whose concept lattice B(K) ...
research
12/20/2018

Relevant Attributes in Formal Contexts

Computing conceptual structures, like formal concept lattices, is in the...
research
08/24/2019

DAST Model: Deciding About Semantic Complexity of a Text

Measuring of text complexity is a needed task in several domains and app...
research
04/17/2023

Automatic Textual Explanations of Concept Lattices

Lattices and their order diagrams are an essential tool for communicatin...

Please sign up or login with your details

Forgot password? Click here to reset