DeepAI AI Chat
Log In Sign Up

Performance Comparison of Simple Transformer and Res-CNN-BiLSTM for Cyberbullying Classification

by   Raunak Joshi, et al.

The task of text classification using Bidirectional based LSTM architectures is computationally expensive and time consuming to train. For this, transformers were discovered which effectively give good performance as compared to the traditional deep learning architectures. In this paper we present a performance based comparison between simple transformer based network and Res-CNN-BiLSTM based network for cyberbullying text classification problem. The results obtained show that transformer we trained with 0.65 million parameters has significantly being able to beat the performance of Res-CNN-BiLSTM with 48.82 million parameters for faster training speeds and more generalized metrics. The paper also compares the 1-dimensional character level embedding network and 100-dimensional glove embedding network with transformer.


page 1

page 2

page 3

page 4


Sequential Learning of Convolutional Features for Effective Text Classification

Text classification has been one of the major problems in natural langua...

Text classification in shipping industry using unsupervised models and Transformer based supervised models

Obtaining labelled data in a particular context could be expensive and t...

Evolving Character-level Convolutional Neural Networks for Text Classification

Character-level convolutional neural networks (char-CNN) require no know...

Transformer-F: A Transformer network with effective methods for learning universal sentence representation

The Transformer model is widely used in natural language processing for ...

An Innovative Word Encoding Method For Text Classification Using Convolutional Neural Network

Text classification plays a vital role today especially with the intensi...

TextCNN with Attention for Text Classification

The vast majority of textual content is unstructured, making automated c...

The Naughtyformer: A Transformer Understands Offensive Humor

Jokes are intentionally written to be funny, but not all jokes are creat...