A Comparative Study of Neural Network Models for Sentence Classification

10/03/2018
by   Phuong Le-Hong, et al.
0

This paper presents an extensive comparative study of four neural network models, including feed-forward networks, convolutional networks, recurrent networks and long short-term memory networks, on two sentence classification datasets of English and Vietnamese text. We show that on the English dataset, the convolutional network models without any feature engineering outperform some competitive sentence classifiers with rich hand-crafted linguistic features. We demonstrate that the GloVe word embeddings are consistently better than both Skip-gram word embeddings and word count vectors. We also show the superiority of convolutional neural network models on a Vietnamese newspaper sentence dataset over strong baseline models. Our experimental results suggest some good practices for applying neural network models in sentence classification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/29/2017

Automatic Argumentative-Zoning Using Word2vec

In comparison with document summarization on the articles from social me...
research
05/26/2018

SJTU-NLP at SemEval-2018 Task 9: Neural Hypernym Discovery with Term Embeddings

This paper describes a hypernym discovery system for our participation i...
research
08/27/2018

Generating Text through Adversarial Training using Skip-Thought Vectors

In the past few years, various advancements have been made in generative...
research
04/18/2018

NTUA-SLP at SemEval-2018 Task 2: Predicting Emojis using RNNs with Context-aware Attention

In this paper we present a deep-learning model that competed at SemEval-...
research
09/29/2021

Tiny-CRNN: Streaming Wakeword Detection In A Low Footprint Setting

In this work, we propose Tiny-CRNN (Tiny Convolutional Recurrent Neural ...
research
02/13/2018

Sentence Boundary Detection for French with Subword-Level Information Vectors and Convolutional Neural Networks

In this work we tackle the problem of sentence boundary detection applie...
research
06/07/2016

Neural Network Models for Implicit Discourse Relation Classification in English and Chinese without Surface Features

Inferring implicit discourse relations in natural language text is the m...

Please sign up or login with your details

Forgot password? Click here to reset