Classification of Audio Segments in Call Center Recordings using Convolutional Recurrent Neural Networks

by   Şükrü Ozan, et al.

Detailed statistical analysis of call center recordings is critical in the customer relationship management point of view. With the recent advances in artificial intelligence, many tasks regarding the calculation of call statistics are now performed automatically. This work proposes a neural network framework where the aim is to correctly identify audio segments and classify them as either customer or agent sections. Accurately identifying these sections gives a fair metric for evaluating agents' performances. We inherited the convolutional recurrent neural network (CRNN) architecture commonly used for such problems as music genre classification. We also tested the same architecture's performance, where the previous class information and the gender information of speakers are also added to the training data labels. We saw that CRNN could generalize the training data and perform well on validation data for this problem with and without the gender information. Moreover, even the training was performed using Turkish speech samples; the trained network was proven to achieve high accuracy for call center recordings in other languages like German and English.


page 3

page 4

page 11


Grammatical gender in Swedish is predictable using recurrent neural networks

The grammatical gender of Swedish nouns is a mystery. While there are fe...

Multi-Language Identification Using Convolutional Recurrent Neural Network

Language Identification, being an important aspect of Automatic Speaker ...

Learning to Denoise Historical Music

We propose an audio-to-audio neural network model that learns to denoise...

Three-class Overlapped Speech Detection using a Convolutional Recurrent Neural Network

In this work, we propose an overlapped speech detection system trained a...

Exploratory Analysis of a Large Flamenco Corpus using an Ensemble of Convolutional Neural Networks as a Structural Annotation Backend

We present computational tools that we developed for the analysis of a l...

A Novel Semi-supervised Framework for Call Center Agent Malpractice Detection via Neural Feature Learning

This work presents a practical solution to the problem of call center ag...

Please sign up or login with your details

Forgot password? Click here to reset