Unsupervised Belief Representation Learning in Polarized Networks with Information-Theoretic Variational Graph Auto-Encoders

10/01/2021
by   Jinning Li, et al.
0

This paper develops a novel unsupervised algorithm for belief representation learning in polarized networks that (i) uncovers the latent dimensions of the underlying belief space and (ii) jointly embeds users and content items (that they interact with) into that space in a manner that facilitates a number of downstream tasks, such as stance detection, stance prediction, and ideology mapping. Inspired by total correlation in information theory, we propose a novel Information-Theoretic Variational Graph Auto-Encoder (InfoVGAE) that learns to project both users and content items (e.g., posts that represent user views) into an appropriate disentangled latent space. In order to better disentangle orthogonal latent variables in that space, we develop total correlation regularization, PI control module, and adopt rectified Gaussian Distribution for the latent space. The latent representation of users and content can then be used to quantify their ideological leaning and detect/predict their stances on issues. We evaluate the performance of the proposed InfoVGAE on three real-world datasets, of which two are collected from Twitter and one from U.S. Congress voting records. The evaluation results show that our model outperforms state-of-the-art unsupervised models and produce comparable result with supervised models. We also discuss stance prediction and user ranking within ideological groups.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2021

Local Disentanglement in Variational Auto-Encoders Using Jacobian L_1 Regularization

There have been many recent advances in representation learning; however...
research
10/18/2020

Variational Capsule Encoder

We propose a novel capsule network based variational encoder architectur...
research
06/12/2020

Disentangled Representation Learning and Generation with Manifold Optimization

Disentanglement is an enjoyable property in representation learning whic...
research
08/10/2017

SESA: Supervised Explicit Semantic Analysis

In recent years supervised representation learning has provided state of...
research
01/21/2021

Blocked and Hierarchical Disentangled Representation From Information Theory Perspective

We propose a novel and theoretical model, blocked and hierarchical varia...
research
07/22/2019

Product of Orthogonal Spheres Parameterization for Disentangled Representation Learning

Learning representations that can disentangle explanatory attributes und...
research
03/31/2020

Cross Scene Prediction via Modeling Dynamic Correlation using Latent Space Shared Auto-Encoders

This work addresses on the following problem: given a set of unsynchroni...

Please sign up or login with your details

Forgot password? Click here to reset