Incremental Transfer Learning in Two-pass Information Bottleneck based Speaker Diarization System for Meetings

02/21/2019
by   Nauman Dawalatabad, et al.
0

The two-pass information bottleneck (TPIB) based speaker diarization system operates independently on different conversational recordings. TPIB system does not consider previously learned speaker discriminative information while diarizing new conversations. Hence, the real time factor (RTF) of TPIB system is high owing to the training time required for the artificial neural network (ANN). This paper attempts to improve the RTF of the TPIB system using an incremental transfer learning approach where the parameters learned by the ANN from other conversations are updated using current conversation rather than learning parameters from scratch. This reduces the RTF significantly. The effectiveness of the proposed approach compared to the baseline IB and the TPIB systems is demonstrated on standard NIST and AMI conversational meeting datasets. With a minor degradation in performance, the proposed system shows a significant improvement of 33.07 on the NIST RT-04Eval and AMI-1 datasets, respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/03/2020

Improving Speaker Identification using Network Knowledge in Criminal Conversational Data

Criminal investigations rely on the collection of conversational data. T...
research
05/22/2023

Exploring Speaker-Related Information in Spoken Language Understanding for Better Speaker Diarization

Speaker diarization(SD) is a classic task in speech processing and is cr...
research
01/13/2020

Detecting depression in dyadic conversations with multimodal narratives and visualizations

Conversations contain a wide spectrum of multimodal information that giv...
research
01/23/2019

TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents

We introduce a new approach to generative data-driven dialogue systems (...
research
06/14/2018

Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce

Building multi-turn information-seeking conversation systems is an impor...
research
06/04/2020

Neuroevolutionary Transfer Learning of Deep Recurrent Neural Networks through Network-Aware Adaptation

Transfer learning entails taking an artificial neural network (ANN) that...
research
10/11/2019

Emotion Recognition in Conversations with Transfer Learning from Generative Conversation Modeling

Recognizing emotions in conversations is a challenging task due to the p...

Please sign up or login with your details

Forgot password? Click here to reset