DeepAI AI Chat
Log In Sign Up

Unsupervised Representation Disentanglement of Text: An Evaluation on Synthetic Datasets

06/07/2021
by   Lan Zhang, et al.
0

To highlight the challenges of achieving representation disentanglement for text domain in an unsupervised setting, in this paper we select a representative set of successfully applied models from the image domain. We evaluate these models on 6 disentanglement metrics, as well as on downstream classification tasks and homotopy. To facilitate the evaluation, we propose two synthetic datasets with known generative factors. Our experiments highlight the existing gap in the text domain and illustrate that certain elements such as representation sparsity (as an inductive bias), or representation coupling with the decoder could impact disentanglement. To the best of our knowledge, our work is the first attempt on the intersection of unsupervised representation disentanglement and text, and provides the experimental framework and datasets for examining future developments in this direction.

READ FULL TEXT

page 6

page 7

08/16/2021

Text-Aware Single Image Specular Highlight Removal

Removing undesirable specular highlight from a single input image is of ...
12/12/2022

T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics

Modern embedding-based metrics for evaluation of generated text generall...
12/23/2022

Do DALL-E and Flamingo Understand Each Other?

A major goal of multimodal research is to improve machine understanding ...
02/24/2022

SMILE: Sequence-to-Sequence Domain Adaption with Minimizing Latent Entropy for Text Image Recognition

Training recognition models with synthetic images have achieved remarkab...
06/08/2022

Motif Mining and Unsupervised Representation Learning for BirdCLEF 2022

We build a classification model for the BirdCLEF 2022 challenge using un...
03/28/2020

Learning Invariant Representation for Unsupervised Image Restoration

Recently, cross domain transfer has been applied for unsupervised image ...

Code Repositories