What is a Markov Matrix?
A Markov Matrix, also known as a stochastic matrix, is used to represent steps in a Markov chain. Each input of the Markov matrix represents the probability of an outcome. A right stochastic matrix means each row sums to 1, whereas a left stochastic matrix means each column sums to 1. In a doubly stochastic matrix, both the rows and the columns sum to 1. The Markov matrix provides a complete way to understand the probabilities of each step in a Markov chain, and is a useful tool in almost any field that requires formal analysis.
Image from Wikipedia.com
Using Markov Matrices in Machine Learning