DeepAI AI Chat
Log In Sign Up

Auto-tagging of Short Conversational Sentences using Natural Language Processing Methods

06/09/2021
by   Şükrü Ozan, et al.
0

In this study, we aim to find a method to auto-tag sentences specific to a domain. Our training data comprises short conversational sentences extracted from chat conversations between company's customer representatives and web site visitors. We manually tagged approximately 14 thousand visitor inputs into ten basic categories, which will later be used in a transformer-based language model with attention mechanisms for the ultimate goal of developing a chatbot application that can produce meaningful dialogue. We considered three different state-of-the-art models and reported their auto-tagging capabilities. We achieved the best performance with the bidirectional encoder representation from transformers (BERT) model. Implementation of the models used in these experiments can be cloned from our GitHub repository and tested for similar auto-tagging problems without much effort.

READ FULL TEXT

page 1

page 4

06/03/2021

Auto-tagging of Short Conversational Sentences using Transformer Methods

The problem of categorizing short speech sentences according to their se...
09/20/2020

Persian Ezafe Recognition Using Transformers and Its Role in Part-Of-Speech Tagging

Ezafe is a grammatical particle in some Iranian languages that links two...
10/05/2018

From direct tagging to Tagging with sentences compression

In essence, the two tagging methods (direct tagging and tagging with sen...
02/16/2021

Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet

Recent years have seen a proliferation of attention mechanisms and the r...
09/30/2021

BERT got a Date: Introducing Transformers to Temporal Tagging

Temporal expressions in text play a significant role in language underst...
02/17/2020

A Financial Service Chatbot based on Deep Bidirectional Transformers

We develop a chatbot using Deep Bidirectional Transformer models (BERT) ...
09/14/2022

vec2text with Round-Trip Translations

We investigate models that can generate arbitrary natural language text ...