Word Sense Disambiguation with LSTM: Do We Really Need 100 Billion Words?

12/09/2017
by   Minh Le, et al.
0

Recently, Yuan et al. (2016) have shown the effectiveness of using Long Short-Term Memory (LSTM) for performing Word Sense Disambiguation (WSD). Their proposed technique outperformed the previous state-of-the-art with several benchmarks, but neither the training data nor the source code was released. This paper presents the results of a reproduction study of this technique using only openly available datasets (GigaWord, SemCore, OMSTI) and software (TensorFlow). From them, it emerged that state-of-the-art results can be obtained with much less data than hinted by Yuan et al. All code and trained models are made freely available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2017

Long Short-Term Memory for Japanese Word Segmentation

This study presents a Long Short-Term Memory (LSTM) neural network appro...
research
12/14/2021

Building on Huang et al. GlossBERT for Word Sense Disambiguation

We propose to take on the problem ofWord Sense Disambiguation (WSD). In ...
research
07/05/2018

Calamari - A High-Performance Tensorflow-based Deep Learning Package for Optical Character Recognition

Optical Character Recognition (OCR) on contemporary and historical data ...
research
02/10/2021

SensPick: Sense Picking for Word Sense Disambiguation

Word sense disambiguation (WSD) methods identify the most suitable meani...
research
10/14/2021

A Dual-Attention Neural Network for Pun Location and Using Pun-Gloss Pairs for Interpretation

Pun location is to identify the punning word (usually a word or a phrase...
research
05/07/2018

MMDenseLSTM: An efficient combination of convolutional and recurrent neural networks for audio source separation

Deep neural networks have become an indispensable technique for audio so...
research
01/23/2019

Stein Variational Online Changepoint Detection with Applications to Hawkes Processes and Neural Networks

Bayesian online changepoint detection (BOCPD) (Adams & MacKay, 2007) off...

Please sign up or login with your details

Forgot password? Click here to reset