Adaptation of Hierarchical Structured Models for Speech Act Recognition in Asynchronous Conversation

by   Tasnim Mohiuddin, et al.

We address the problem of speech act recognition (SAR) in asynchronous conversations (forums, emails). Unlike synchronous conversations (e.g., meetings, phone), asynchronous domains lack large labeled datasets to train an effective SAR model. In this paper, we propose methods to effectively leverage abundant unlabeled conversational data and the available labeled data from synchronous domains. We carry out our research in three main steps. First, we introduce a neural architecture based on hierarchical LSTMs and conditional random fields (CRF) for SAR, and show that our method outperforms existing methods when trained on in-domain data only. Second, we improve our initial SAR models by semi-supervised learning in the form of pretrained word embeddings learned from a large unlabeled conversational corpus. Finally, we employ adversarial training to improve the results further by leveraging the labeled data from synchronous domains and by explicitly modeling the distributional shift in two domains.


Semi-supervised Complex-valued GAN for Polarimetric SAR Image Classification

Polarimetric synthetic aperture radar (PolSAR) images are widely used in...

Unsupervised Adaptation with Interpretable Disentangled Representations for Distant Conversational Speech Recognition

The current trend in automatic speech recognition is to leverage large a...

Graph-based Active Learning for Semi-supervised Classification of SAR Data

We present a novel method for classification of Synthetic Aperture Radar...

Flood Segmentation on Sentinel-1 SAR Imagery with Semi-Supervised Learning

Floods wreak havoc throughout the world, causing billions of dollars in ...

What, Where and How to Transfer in SAR Target Recognition Based on Deep CNNs

Deep convolutional neural networks (DCNNs) have attracted much attention...

Unsupervised domain-agnostic identification of product names in social media posts

Product name recognition is a significant practical problem, spurred by ...

Code Repositories