Cross-domain Variational Capsules for Information Extraction

by   Akash Nagaraj, et al.

In this paper, we present a characteristic extraction algorithm and the Multi-domain Image Characteristics Dataset of characteristic-tagged images to simulate the way a human brain classifies cross-domain information and generates insight. The intent was to identify prominent characteristics in data and use this identification mechanism to auto-generate insight from data in other unseen domains. An information extraction algorithm is proposed which is a combination of Variational Autoencoders (VAEs) and Capsule Networks. Capsule Networks are used to decompose images into their individual features and VAEs are used to explore variations on these decomposed features. Thus, making the model robust in recognizing characteristics from variations of the data. A noteworthy point is that the algorithm uses efficient hierarchical decoding of data which helps in richer output interpretation. Noticing a dearth in the number of datasets that contain visible characteristics in images belonging to various domains, the Multi-domain Image Characteristics Dataset was created and made publicly available. It consists of thousands of images across three domains. This dataset was created with the intent of introducing a new benchmark for fine-grained characteristic recognition tasks in the future.


Real-time Action Recognition for Fine-Grained Actions and The Hand Wash Dataset

In this paper we present a three-stream algorithm for real-time action r...

Domain Generalization for Object Recognition with Multi-task Autoencoders

The problem of domain generalization is to take knowledge acquired from ...

Unsupervised Cross-Domain Prerequisite Chain Learning using Variational Graph Autoencoders

Learning prerequisite chains is an essential task for efficiently acquir...

DORIC : Domain Robust Fine-Tuning for Open Intent Clustering through Dependency Parsing

We present our work on Track 2 in the Dialog System Technology Challenge...

Cross-Domain Aspect Extraction using Transformers Augmented with Knowledge Graphs

The extraction of aspect terms is a critical step in fine-grained sentim...

Efficient Variational Graph Autoencoders for Unsupervised Cross-domain Prerequisite Chains

Prerequisite chain learning helps people acquire new knowledge efficient...

Please sign up or login with your details

Forgot password? Click here to reset