UTSA NLP at SemEval-2022 Task 4: An Exploration of Simple Ensembles of Transformers, Convolutional, and Recurrent Neural Networks

03/28/2022
by   Xingmeng Zhao, et al.
0

The act of appearing kind or helpful via the use of but having a feeling of superiority condescending and patronizing language can have have serious mental health implications to those that experience it. Thus, detecting this condescending and patronizing language online can be useful for online moderation systems. Thus, in this manuscript, we describe the system developed by Team UTSA SemEval-2022 Task 4, Detecting Patronizing and Condescending Language. Our approach explores the use of several deep learning architectures including RoBERTa, convolutions neural networks, and Bidirectional Long Short-Term Memory Networks. Furthermore, we explore simple and effective methods to create ensembles of neural network models. Overall, we experimented with several ensemble models and found that the a simple combination of five RoBERTa models achieved an F-score of .6441 on the development dataset and .5745 on the final test dataset. Finally, we also performed a comprehensive error analysis to better understand the limitations of the model and provide ideas for further research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/23/2020

Deep Learning based, end-to-end metaphor detection in Greek language with Recurrent and Convolutional Neural Networks

This paper presents and benchmarks a number of end-to-end Deep Learning ...
research
07/28/2020

SalamNET at SemEval-2020 Task12: Deep Learning Approach for Arabic Offensive Language Detection

This paper describes SalamNET, an Arabic offensive language detection sy...
research
02/07/2016

Exploring the Limits of Language Modeling

In this work we explore recent advances in Recurrent Neural Networks for...
research
08/13/2018

DeepBase: Deep Inspection of Neural Networks

Although deep learning models perform remarkably across a range of tasks...
research
08/16/2022

BERT(s) to Detect Multiword Expressions

Multiword expressions (MWEs) present groups of words in which the meanin...
research
02/20/2021

An Attention Ensemble Approach for Efficient Text Classification of Indian Languages

The recent surge of complex attention-based deep learning architectures ...
research
10/07/2020

Combining Deep Learning and String Kernels for the Localization of Swiss German Tweets

In this work, we introduce the methods proposed by the UnibucKernel team...

Please sign up or login with your details

Forgot password? Click here to reset