A Rule-based/BPSO Approach to Produce Low-dimensional Semantic Basis Vectors Set

11/24/2021
by   Atefe Pakzad, et al.
0

We intend to generate low-dimensional explicit distributional semantic vectors. In explicit semantic vectors, each dimension corresponds to a word, so word vectors are interpretable. In this research, we propose a new approach to obtain low-dimensional explicit semantic vectors. First, the proposed approach considers the three criteria Word Similarity, Number of Zero, and Word Frequency as features for the words in a corpus. Then, we extract some rules for obtaining the initial basis words using a decision tree that is drawn based on the three features. Second, we propose a binary weighting method based on the Binary Particle Swarm Optimization algorithm that obtains N_B = 1000 context words. We also use a word selection method that provides N_S = 1000 context words. Third, we extract the golden words of the corpus based on the binary weighting method. Then, we add the extracted golden words to the context words that are selected by the word selection method as the golden context words. We use the ukWaC corpus for constructing the word vectors. We use MEN, RG-65, and SimLex-999 test sets to evaluate the word vectors. We report the results compared to a baseline that uses 5k most frequent words in the corpus as context words. The baseline method uses a fixed window to count the co-occurrences. We obtain the word vectors using the 1000 selected context words together with the golden context words. Our approach compared to the Baseline method increases the Spearman correlation coefficient for the MEN, RG-65, and SimLex-999 test sets by 4.66

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2015

Measuring Word Significance using Distributed Representations of Words

Distributed representations of words as real-valued vectors in a relativ...
research
09/26/2017

Polysemy Detection in Distributed Representation of Word Sense

In this paper, we propose a statistical test to determine whether a give...
research
10/04/2018

Building a language evolution tree based on word vector combination model

In this paper, we try to explore the evolution of language through case ...
research
07/10/2018

Paired Comparison Sentiment Scores

The method of paired comparisons is an established method in psychology....
research
08/28/2020

Temporal Random Indexing of Context Vectors Applied to Event Detection

In this paper we explore new representations for encoding language data....
research
04/17/2019

Circularly squarefree words and unbordered conjugates: a new approach

Using a new approach based on automatic sequences, logic, and a decision...
research
08/19/2019

The Natural Selection of Words: Finding the Features of Fitness

We introduce a dataset for studying the evolution of words, constructed ...

Please sign up or login with your details

Forgot password? Click here to reset