Quasi-symbolic explanatory NLI via disentanglement: A geometrical examination

10/12/2022
by   Yingji Zhang, et al.
0

Disentangling the encodings of neural models is a fundamental aspect for improving interpretability, semantic control, and understanding downstream task performance in Natural Language Processing. The connection points between disentanglement and downstream tasks, however, remains underexplored from a explanatory standpoint. This work presents a methodology for assessment of geometrical properties of the resulting latent space w.r.t. vector operations and semantic disentanglement in quantitative and qualitative terms, based on a VAE-based supervised framework. Empirical results indicate that the role-contents of explanations, such as ARG0-animal, are disentangled in the latent space, which provides us a chance for controlling the explanation generation by manipulating the traversal of vector over latent space.

READ FULL TEXT

page 3

page 8

page 10

page 16

research
05/02/2023

Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networks

Disentangling sentence representations over continuous spaces can be a c...
research
07/06/2019

Generating Sentences from Disentangled Syntactic and Semantic Spaces

Variational auto-encoders (VAEs) are widely used in natural language gen...
research
12/15/2022

Reliable Measures of Spread in High Dimensional Latent Spaces

Understanding geometric properties of natural language processing models...
research
03/06/2023

Towards Composable Distributions of Latent Space Augmentations

We propose a composable framework for latent space image augmentation th...
research
12/06/2021

Encouraging Disentangled and Convex Representation with Controllable Interpolation Regularization

We focus on controllable disentangled representation learning (C-Dis-RL)...
research
04/20/2020

Variational Inference for Learning Representations of Natural Language Edits

Document editing has become a pervasive component of production of infor...
research
09/29/2021

Designing Complex Experiments by Applying Unsupervised Machine Learning

Design of experiments (DOE) is playing an essential role in learning and...

Please sign up or login with your details

Forgot password? Click here to reset