Shallow Domain Adaptive Embeddings for Sentiment Analysis

08/16/2019
by   Prathusha K Sarma, et al.
0

This paper proposes a way to improve the performance of existing algorithms for text classification in domains with strong language semantics. We propose a domain adaptation layer learns weights to combine a generic and a domain specific (DS) word embedding into a domain adapted (DA) embedding. The DA word embeddings are then used as inputs to a generic encoder + classifier framework to perform a downstream task such as classification. This adaptation layer is particularly suited to datasets that are modest in size, and which are, therefore, not ideal candidates for (re)training a deep neural network architecture. Results on binary and multi-class classification tasks using popular encoder architectures, including current state-of-the-art methods (with and without the shallow adaptation layer) show the effectiveness of the proposed approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/11/2018

Domain Adapted Word Embeddings for Improved Sentiment Classification

Generic word embeddings are trained on large-scale generic corpora; Doma...
research
03/26/2019

Deep Learning and Word Embeddings for Tweet Classification for Crisis Response

Tradition tweet classification models for crisis response focus on convo...
research
11/01/2021

Domain-adaptation of spherical embeddings

Domain adaptation of embedding models, updating a generic embedding to t...
research
07/02/2020

Sequential Domain Adaptation through Elastic Weight Consolidation for Sentiment Analysis

Elastic Weight Consolidation (EWC) is a technique used in overcoming cat...
research
10/15/2022

Attention Regularized Laplace Graph for Domain Adaptation

In leveraging manifold learning in domain adaptation (DA), graph embeddi...
research
03/12/2017

A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation

Recently, DNN model compression based on network architecture design, e....
research
10/08/2020

Large Scale Indexing of Generic Medical Image Data using Unbiased Shallow Keypoints and Deep CNN Features

We propose a unified appearance model accounting for traditional shallow...

Please sign up or login with your details

Forgot password? Click here to reset