Integrating extracted information from bert and multiple embedding methods with the deep neural network for humour detection

05/11/2021
by   Rida Miraj, et al.
0

Humour detection from sentences has been an interesting and challenging task in the last few years. In attempts to highlight humour detection, most research was conducted using traditional approaches of embedding, e.g., Word2Vec or Glove. Recently BERT sentence embedding has also been used for this task. In this paper, we propose a framework for humour detection in short texts taken from news headlines. Our proposed framework (IBEN) attempts to extract information from written text via the use of different layers of BERT. After several trials, weights were assigned to different layers of the BERT model. The extracted information was then sent to a Bi-GRU neural network as an embedding matrix. We utilized the properties of some external embedding models. A multi-kernel convolution in our neural network was also employed to extract higher-level sentence representations. This framework performed very well on the task of humour detection.

READ FULL TEXT
research
04/27/2020

ColBERT: Using BERT Sentence Embedding for Humor Detection

Automatic humor detection has interesting use cases in modern technologi...
research
11/30/2021

Text classification problems via BERT embedding method and graph convolutional neural network

This paper presents the novel way combining the BERT embedding method an...
research
05/29/2021

Constructing Flow Graphs from Procedural Cybersecurity Texts

Following procedural texts written in natural languages is challenging. ...
research
06/27/2019

Relating Simple Sentence Representations in Deep Neural Networks and the Brain

What is the relationship between sentence representations learned by dee...
research
09/05/2023

Using a Nearest-Neighbour, BERT-Based Approach for Scalable Clone Detection

Code clones can detrimentally impact software maintenance and manually d...
research
04/14/2021

An Interpretability Illusion for BERT

We describe an "interpretability illusion" that arises when analyzing th...
research
05/11/2021

kdehumor at semeval-2020 task 7: a neural network model for detecting funniness in dataset humicroedit

This paper describes our contribution to SemEval-2020 Task 7: Assessing ...

Please sign up or login with your details

Forgot password? Click here to reset