UR-FUNNY: A Multimodal Language Dataset for Understanding Humor

04/14/2019
by   Md. Kamrul Hasan, et al.
22

Humor is a unique and creative communicative behavior displayed during social interactions. It is produced in a multimodal manner, through the usage of words (text), gestures (vision) and prosodic cues (acoustic). Understanding humor from these three modalities falls within boundaries of multimodal language; a recent research trend in natural language processing that models natural language as it happens in face-to-face communication. Although humor detection is an established research area in NLP, in a multimodal context it is an understudied area. This paper presents a diverse multimodal dataset, called UR-FUNNY, to open the door to understanding multimodal language used in expressing humor. The dataset and accompanying studies, present a framework in multimodal humor detection for the natural language processing community. UR-FUNNY is publicly available for research.

READ FULL TEXT

page 1

page 4

page 7

research
11/01/2018

How2: A Large-scale Dataset for Multimodal Language Understanding

In this paper, we introduce How2, a multimodal collection of instruction...
research
05/18/2023

Expanding the Role of Affective Phenomena in Multimodal Interaction Research

In recent decades, the field of affective computing has made substantial...
research
07/29/2020

Presentation and Analysis of a Multimodal Dataset for Grounded LanguageLearning

Grounded language acquisition – learning how language-based interactions...
research
01/14/2021

Enabling Robots to Draw and Tell: Towards Visually Grounded Multimodal Description Generation

Socially competent robots should be equipped with the ability to perceiv...
research
06/05/2019

Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)

Sarcasm is often expressed through several verbal and non-verbal cues, e...
research
05/12/2021

Designing Multimodal Datasets for NLP Challenges

In this paper, we argue that the design and development of multimodal da...
research
02/13/2022

Emotion Based Hate Speech Detection using Multimodal Learning

In recent years, monitoring hate speech and offensive language on social...

Please sign up or login with your details

Forgot password? Click here to reset