An Ensemble Approach to Question Classification: Integrating Electra Transformer, GloVe, and LSTM

08/13/2023
by   Sanad Aburass, et al.
0

This paper introduces a novel ensemble approach for question classification using state-of-the-art models – Electra, GloVe, and LSTM. The proposed model is trained and evaluated on the TREC dataset, a well-established benchmark for question classification tasks. The ensemble model combines the strengths of Electra, a transformer-based model for language understanding, GloVe, a global vectors for word representation, and LSTM, a recurrent neural network variant, providing a robust and efficient solution for question classification. Extensive experiments were carried out to compare the performance of the proposed ensemble approach with other cutting-edge models, such as BERT, RoBERTa, and DistilBERT. Our results demonstrate that the ensemble model outperforms these models across all evaluation metrics, achieving an accuracy of 0.8 on the test set. These findings underscore the effectiveness of the ensemble approach in enhancing the performance of question classification tasks, and invite further exploration of ensemble methods in natural language processing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2015

A C-LSTM Neural Network for Text Classification

Neural network models have been demonstrated to be capable of achieving ...
research
02/14/2020

Stress Test Evaluation of Transformer-based Models in Natural Language Understanding Tasks

There has been significant progress in recent years in the field of Natu...
research
08/26/2019

Ensemble approach for natural language question answering problem

Machine comprehension, answering a question depending on a given context...
research
01/17/2022

RuMedBench: A Russian Medical Language Understanding Benchmark

The paper describes the open Russian medical language understanding benc...
research
01/15/2022

Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems

Large transformer models can highly improve Answer Sentence Selection (A...
research
08/31/2018

Neural DrugNet

In this paper, we describe the system submitted for the shared task on S...
research
03/19/2017

Native Language Identification using Stacked Generalization

Ensemble methods using multiple classifiers have proven to be the most s...

Please sign up or login with your details

Forgot password? Click here to reset