Profitable Trade-Off Between Memory and Performance In Multi-Domain Chatbot Architectures

11/06/2021
by   D. Emre Taşar, et al.
0

Text classification problem is a very broad field of study in the field of natural language processing. In short, the text classification problem is to determine which of the previously determined classes the given text belongs to. Successful studies have been carried out in this field in the past studies. In the study, Bidirectional Encoder Representations for Transformers (BERT), which is a frequently preferred method for solving the classification problem in the field of natural language processing, is used. By solving classification problems through a single model to be used in a chatbot architecture, it is aimed to alleviate the load on the server that will be created by more than one model used for solving more than one classification problem. At this point, with the masking method applied during the estimation of a single BERT model, which was created for classification in more than one subject, the estimation of the model was provided on a problem-based basis. Three separate data sets covering different fields from each other are divided by various methods in order to complicate the problem, and classification problems that are very close to each other in terms of field are also included in this way. The dataset used in this way consists of five classification problems with 154 classes. A BERT model containing all classification problems and other BERT models trained specifically for the problems were compared with each other in terms of performance and the space they occupied on the server.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2021

Ad Text Classification with Transformer-Based Natural Language Processing Methods

In this study, a natural language processing-based (NLP-based) method is...
research
10/28/2020

NILM as a regression versus classification problem: the importance of thresholding

Non-Intrusive Load Monitoring (NILM) aims to predict the status or consu...
research
04/09/2021

BERT-based Chinese Text Classification for Emergency Domain with a Novel Loss Function

This paper proposes an automatic Chinese text categorization method for ...
research
06/10/2019

A cost-reducing partial labeling estimator in text classification problem

We propose a new approach to address the text classification problems wh...
research
02/19/2016

Learning to SMILE(S)

This paper shows how one can directly apply natural language processing ...
research
02/24/2021

RoBERTa-wwm-ext Fine-Tuning for Chinese Text Classification

Bidirectional Encoder Representations from Transformers (BERT) have show...
research
06/23/2022

Proposal and Verification of Novel Machine Learning on Classification Problems

This paper aims at proposing a new machine learning for classification p...

Please sign up or login with your details

Forgot password? Click here to reset