Path-entropy maximized Markov chains for dimensionality reduction

06/13/2018
by   Purushottam D. Dixit, et al.
0

Stochastic kernel based dimensionality reduction methods have become popular in the last decade. The central component of these methods is a symmetric kernel that quantifies the vicinity of pairs of data points and a kernel-induced Markov chain. Typically, the Markov chain is fully specified by the kernel through row normalization. However, it may be desirable to impose user-specified stationary-state and dynamical constraints on the Markov chain. Notably, no systematic framework exists to prescribe user-defined constraints on Markov chains. Here, we use a path entropy maximization based approach to derive Markov chains on data using a kernel and additional user-defined constraints. We illustrate the usefulness of the path entropy normalization procedure with multiple real and artificial data sets. All scripts are available at: https://github.com/dixitpd/maxcaldiffmap

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2022

Information-Theoretic Reduction of Markov Chains

We survey information-theoretic approaches to the reduction of Markov ch...
research
03/10/2019

Extreme events of higher-order Markov chains: hidden tail chains and extremal Yule-Walker equations

We derive some key extremal features for kth order Markov chains, which ...
research
03/21/2019

Reduction of Markov Chains using a Value-of-Information-Based Approach

In this paper, we propose an approach to obtain reduced-order models of ...
research
06/25/2020

A metric on directed graphs and Markov chains based on hitting probabilities

The shortest-path, commute time, and diffusion distances on undirected g...
research
01/31/2021

Transition kernel couplings of the Metropolis-Hastings algorithm

Couplings play a central role in the analysis of Markov chain convergenc...
research
05/23/2023

SNEkhorn: Dimension Reduction with Symmetric Entropic Affinities

Many approaches in machine learning rely on a weighted graph to encode t...
research
08/20/2020

Markov Chain-Based Stochastic Strategies for Robotic Surveillance

This article surveys recent advancements of strategy designs for persist...

Please sign up or login with your details

Forgot password? Click here to reset