Text classification problems via BERT embedding method and graph convolutional neural network

11/30/2021
by   Loc Hoang Tran, et al.
0

This paper presents the novel way combining the BERT embedding method and the graph convolutional neural network. This combination is employed to solve the text classification problem. Initially, we apply the BERT embedding method to the texts (in the BBC news dataset and the IMDB movie reviews dataset) in order to transform all the texts to numerical vector. Then, the graph convolutional neural network will be applied to these numerical vectors to classify these texts into their ap-propriate classes/labels. Experiments show that the performance of the graph convolutional neural network model is better than the perfor-mances of the combination of the BERT embedding method with clas-sical machine learning models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2020

VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classification

Much progress has been made recently on text classification with methods...
research
07/07/2022

Machine learning of percolation models using graph convolutional neural networks

Percolation is an important topic in climate, physics, materials science...
research
05/11/2021

Integrating extracted information from bert and multiple embedding methods with the deep neural network for humour detection

Humour detection from sentences has been an interesting and challenging ...
research
04/27/2020

ColBERT: Using BERT Sentence Embedding for Humor Detection

Automatic humor detection has interesting use cases in modern technologi...
research
01/13/2021

geoGAT: Graph Model Based on Attention Mechanism for Geographic Text Classification

In the area of geographic information processing. There are few research...
research
10/09/2020

Gini in a Bottleneck: Gotta Train Me the Right Way

Due to the nature of deep learning approaches, it is inherently difficul...
research
12/03/2020

Graph Convolutional Neural Networks for Body Force Prediction

Many scientific and engineering processes produce spatially unstructured...

Please sign up or login with your details

Forgot password? Click here to reset