Task-specific Word Identification from Short Texts Using a Convolutional Neural Network

06/03/2017
by   Shuhan Yuan, et al.
0

Task-specific word identification aims to choose the task-related words that best describe a short text. Existing approaches require well-defined seed words or lexical dictionaries (e.g., WordNet), which are often unavailable for many applications such as social discrimination detection and fake review detection. However, we often have a set of labeled short texts where each short text has a task-related class label, e.g., discriminatory or non-discriminatory, specified by users or learned by classification algorithms. In this paper, we focus on identifying task-specific words and phrases from short texts by exploiting their class labels rather than using seed words or lexical dictionaries. We consider the task-specific word and phrase identification as feature learning. We train a convolutional neural network over a set of labeled texts and use score vectors to localize the task-specific words and phrases. Experimental results on sentiment word identification show that our approach significantly outperforms existing methods. We further conduct two case studies to show the effectiveness of our approach. One case study on a crawled tweets dataset demonstrates that our approach can successfully capture the discrimination-related words/phrases. The other case study on fake review detection shows that our approach can identify the fake-review words/phrases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2015

Learning to Understand Phrases by Embedding the Dictionary

Distributional models that learn rich semantic word representations are ...
research
06/28/2022

Phrase Mining

Extracting frequent words from a collection of texts is performed on a g...
research
10/08/2015

Mapping Unseen Words to Task-Trained Embedding Spaces

We consider the supervised training setting in which we learn task-speci...
research
01/09/2017

Task-Specific Attentive Pooling of Phrase Alignments Contributes to Sentence Matching

This work studies comparatively two typical sentence matching tasks: tex...
research
11/01/2018

Learning to Describe Phrases with Local and Global Contexts

When reading a text, it is common to become stuck on unfamiliar words an...
research
06/04/2022

Atypical lexical abbreviations identification in Russian medical texts

Abbreviation is a method of word formation that aims to construct the sh...
research
04/30/2020

User-Guided Aspect Classification for Domain-Specific Texts

Aspect classification, identifying aspects of text segments, facilitates...

Please sign up or login with your details

Forgot password? Click here to reset