DeepAI AI Chat
Log In Sign Up

CRNN: A Joint Neural Network for Redundancy Detection

06/04/2017
by   Xinyu Fu, et al.
0

This paper proposes a novel framework for detecting redundancy in supervised sentence categorisation. Unlike traditional singleton neural network, our model incorporates character-aware convolutional neural network (Char-CNN) with character-aware recurrent neural network (Char-RNN) to form a convolutional recurrent neural network (CRNN). Our model benefits from Char-CNN in that only salient features are selected and fed into the integrated Char-RNN. Char-RNN effectively learns long sequence semantics via sophisticated update mechanism. We compare our framework against the state-of-the-art text classification algorithms on four popular benchmarking corpus. For instance, our model achieves competing precision rate, recall ratio, and F1 score on the Google-news data-set. For twenty-news-groups data stream, our algorithm obtains the optimum on precision rate, recall ratio, and F1 score. For Brown Corpus, our framework obtains the best F1 score and almost equivalent precision rate and recall ratio over the top competitor. For the question classification collection, CRNN produces the optimal recall rate and F1 score and comparable precision rate. We also analyse three different RNN hidden recurrent cells' impact on performance and their runtime efficiency. We observe that MGU achieves the optimal runtime and comparable performance against GRU and LSTM. For TFIDF based algorithms, we experiment with word2vec, GloVe, and sent2vec embeddings and report their performance differences.

READ FULL TEXT
09/28/2019

W-RNN: News text classification based on a Weighted RNN

Most of the information is stored as text, so text mining is regarded as...
12/23/2020

Convolutional Neural Network for Elderly Wandering Prediction in Indoor Scenarios

This work proposes a way to detect the wandering activity of Alzheimer's...
12/05/2016

We used Neural Networks to Detect Clickbaits: You won't believe what happened Next!

Online content publishers often use catchy headlines for their articles ...
09/12/2020

Interpretable Machine Learning Approaches to Prediction of Chronic Homelessness

We introduce a machine learning approach to predict chronic homelessness...
06/24/2018

Character-Level Feature Extraction with Densely Connected Networks

Generating character-level features is an important step for achieving g...
09/28/2022

CourtNet for Infrared Small-Target Detection

Infrared small-target detection (ISTD) is an important computer vision t...
02/14/2023

Generation of Highlights from Research Papers Using Pointer-Generator Networks and SciBERT Embeddings

Nowadays many research articles are prefaced with research highlights to...