TIB-VA at SemEval-2022 Task 5: A Multimodal Architecture for the Detection and Classification of Misogynous Memes

04/13/2022
by   Sherzod Hakimov, et al.
0

The detection of offensive, hateful content on social media is a challenging problem that affects many online users on a daily basis. Hateful content is often used to target a group of people based on ethnicity, gender, religion and other factors. The hate or contempt toward women has been increasing on social platforms. Misogynous content detection is especially challenging when textual and visual modalities are combined to form a single context, e.g., an overlay text embedded on top of an image, also known as meme. In this paper, we present a multimodal architecture that combines textual and visual features in order to detect misogynous meme content. The proposed architecture is evaluated in the SemEval-2022 Task 5: MAMI - Multimedia Automatic Misogyny Identification challenge under the team name TIB-VA. Our solution obtained the best result in the Task-B where the challenge is to classify whether a given document is misogynous and further identify the main sub-classes of shaming, stereotype, objectification, and violence.

READ FULL TEXT
research
07/16/2018

A Multimodal Approach to Predict Social Media Popularity

Multiple modalities represent different aspects by which information is ...
research
12/09/2021

Combining Textual Features for the Detection of Hateful and Offensive Language

The detection of offensive, hateful and profane language has become a cr...
research
11/25/2020

Multimodal Learning for Hateful Memes Detection

Memes are multimedia documents containing images and phrases that usuall...
research
06/15/2021

Benchmark dataset of memes with text transcriptions for automatic detection of multi-modal misogynistic content

In this paper we present a benchmark dataset generated as part of a proj...
research
02/13/2022

Emotion Based Hate Speech Detection using Multimodal Learning

In recent years, monitoring hate speech and offensive language on social...
research
03/06/2017

Cats and Captions vs. Creators and the Clock: Comparing Multimodal Content to Context in Predicting Relative Popularity

The content of today's social media is becoming more and more rich, incr...
research
12/11/2022

Multimodal and Explainable Internet Meme Classification

Warning: this paper contains content that may be offensive or upsetting....

Please sign up or login with your details

Forgot password? Click here to reset