Adapting predominant and novel sense discovery algorithms for identifying corpus-specific sense differences

02/01/2018

∙

Word senses are not static and may have temporal, spatial or corpus-specific scopes. Identifying such scopes might benefit the existing WSD systems largely. In this paper, while studying corpus specific word senses, we adapt three existing predominant and novel-sense discovery algorithms to identify these corpus-specific senses. We make use of text data available in the form of millions of digitized books and newspaper archives as two different sources of corpora and propose automated methods to identify corpus-specific word senses at various time points. We conduct an extensive and thorough human judgment experiment to rigorously evaluate and compare the performance of these approaches. Post adaptation, the output of the three algorithms are in the same format and the accuracy results are also comparable, with roughly 45-60 reported corpus-specific senses being judged as genuine.

READ FULL TEXT

Adapting predominant and novel sense discovery algorithms for identifying corpus-specific sense differences

That's sick dude!: Automatic identification of word sense change across different timescales

Large Scale Substitution-based Word Sense Induction

UMDuluth-CS8761 at SemEval-2018 Task 9: Hypernym Discovery using Hearst Patterns, Co-occurrence frequencies and Word Embeddings

Word sense induction using word embeddings and community detection in complex networks

A Comparison between Supervised Learning Algorithms for Word Sense Disambiguation

Topic Sensitive Attention on Generic Corpora Corrects Sense Bias in Pretrained Embeddings

Solving Arithmetic Word Problems Automatically Using Transformer and Unambiguous Representations

Adapting predominant and novel sense discovery algorithms for identifying corpus-specific sense differences

Related Research

That's sick dude!: Automatic identification of word sense change across different timescales

Large Scale Substitution-based Word Sense Induction

UMDuluth-CS8761 at SemEval-2018 Task 9: Hypernym Discovery using Hearst Patterns, Co-occurrence frequencies and Word Embeddings

Word sense induction using word embeddings and community detection in complex networks

A Comparison between Supervised Learning Algorithms for Word Sense Disambiguation

Topic Sensitive Attention on Generic Corpora Corrects Sense Bias in Pretrained Embeddings

Solving Arithmetic Word Problems Automatically Using Transformer and Unambiguous Representations