Adaptation of Hierarchical Structured Models for Speech Act Recognition in Asynchronous Conversation

04/01/2019
by   Tasnim Mohiuddin, et al.
0

We address the problem of speech act recognition (SAR) in asynchronous conversations (forums, emails). Unlike synchronous conversations (e.g., meetings, phone), asynchronous domains lack large labeled datasets to train an effective SAR model. In this paper, we propose methods to effectively leverage abundant unlabeled conversational data and the available labeled data from synchronous domains. We carry out our research in three main steps. First, we introduce a neural architecture based on hierarchical LSTMs and conditional random fields (CRF) for SAR, and show that our method outperforms existing methods when trained on in-domain data only. Second, we improve our initial SAR models by semi-supervised learning in the form of pretrained word embeddings learned from a large unlabeled conversational corpus. Finally, we employ adversarial training to improve the results further by leveraging the labeled data from synchronous domains and by explicitly modeling the distributional shift in two domains.

READ FULL TEXT
research
06/09/2019

Semi-supervised Complex-valued GAN for Polarimetric SAR Image Classification

Polarimetric synthetic aperture radar (PolSAR) images are widely used in...
research
06/13/2018

Unsupervised Adaptation with Interpretable Disentangled Representations for Distant Conversational Speech Recognition

The current trend in automatic speech recognition is to leverage large a...
research
08/31/2023

Semi-Supervised SAR ATR Framework with Transductive Auxiliary Segmentation

Convolutional neural networks (CNNs) have achieved high performance in s...
research
03/20/2023

A Global Model Approach to Robust Few-Shot SAR Automatic Target Recognition

In real-world scenarios, it may not always be possible to collect hundre...
research
06/06/2023

RescueSpeech: A German Corpus for Speech Recognition in Search and Rescue Domain

Despite recent advancements in speech recognition, there are still diffi...
research
07/18/2021

Flood Segmentation on Sentinel-1 SAR Imagery with Semi-Supervised Learning

Floods wreak havoc throughout the world, causing billions of dollars in ...

Please sign up or login with your details

Forgot password? Click here to reset