Synergistic Union of Word2Vec and Lexicon for Domain Specific Semantic Similarity

06/06/2017
by   Keet Sugathadasa, et al.
0

Semantic similarity measures are an important part in Natural Language Processing tasks. However Semantic similarity measures built for general use do not perform well within specific domains. Therefore in this study we introduce a domain specific semantic similarity measure that was created by the synergistic union of word2vec, a word embedding method that is used for semantic similarity calculation and lexicon based (lexical) semantic similarity methods. We prove that this proposed methodology out performs word embedding methods trained on generic corpus and methods trained on domain specific corpus but do not use lexical semantic similarity methods to augment the results. Further, we prove that text lemmatization can improve the performance of word embedding methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2016

Evaluation method of word embedding by roots and affixes

Word embedding has been shown to be remarkably effective in a lot of Nat...
research
10/21/2019

A Comparison of Semantic Similarity Methods for Maximum Human Interpretability

The inclusion of semantic information in any similarity measures improve...
research
12/22/2017

Novel Ranking-Based Lexical Similarity Measure for Word Embedding

Distributional semantics models derive word space from linguistic items ...
research
12/18/2022

Synthesis and Evaluation of a Domain-specific Large Data Set for Dungeons Dragons

This paper introduces the Forgotten Realms Wiki (FRW) data set and domai...
research
07/03/2023

Automatic Design of Semantic Similarity Ensembles Using Grammatical Evolution

Semantic similarity measures are widely used in natural language process...
research
12/16/2021

Khmer Word Search: Challenges, Solutions, and Semantic-Aware Search

Search is one of the key functionalities in digital platforms and applic...
research
03/13/2021

Embedding Calibration for Music Semantic Similarity using Auto-regressive Transformer

One of the advantages of using natural language processing (NLP) technol...

Please sign up or login with your details

Forgot password? Click here to reset