FH-SWF SG at GermEval 2021: Using Transformer-Based Language Models to Identify Toxic, Engaging, Fact-Claiming Comments

09/07/2021
by   Christian Gawron, et al.
0

In this paper we describe the methods we used for our submissions to the GermEval 2021 shared task on the identification of toxic, engaging, and fact-claiming comments. For all three subtasks we fine-tuned freely available transformer-based models from the Huggingface model hub. We evaluated the performance of various pre-trained models after fine-tuning on 80 training data with different hyperparameters and submitted predictions of the two best performing resulting models. We found that this approach worked best for subtask 3, for which we achieved an F1-score of 0.736.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2021

MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection

This paper describes our system for SemEval-2021 Task 5 on Toxic Spans D...
research
08/11/2023

Identification of the Relevance of Comments in Codes Using Bag of Words and Transformer Based Models

The Forum for Information Retrieval (FIRE) started a shared task this ye...
research
09/06/2021

Data Science Kitchen at GermEval 2021: A Fine Selection of Hand-Picked Features, Delivered Fresh from the Oven

This paper presents the contribution of the Data Science Kitchen at Germ...
research
09/07/2021

FHAC at GermEval 2021: Identifying German toxic, engaging, and fact-claiming comments with ensemble learning

The availability of language representations learned by large pretrained...
research
04/17/2021

UPB at SemEval-2021 Task 5: Virtual Adversarial Training for Toxic Spans Detection

The real-world impact of polarization and toxicity in the online sphere ...
research
02/20/2023

Boosting classification reliability of NLP transformer models in the long run

Transformer-based machine learning models have become an essential tool ...
research
05/23/2022

Use of Transformer-Based Models for Word-Level Transliteration of the Book of the Dean of Lismore

The Book of the Dean of Lismore (BDL) is a 16th-century Scottish Gaelic ...

Please sign up or login with your details

Forgot password? Click here to reset