Low-rank tensor methods for Markov chains with applications to tumor progression models

06/15/2020
by   Peter Georg, et al.
0

Continuous-time Markov chains describing interacting processes exhibit a state space that grows exponentially in the number of processes. This state-space explosion renders the computation or storage of the time-marginal distribution, which is defined as the solution of a certain linear system, infeasible using classical methods. We consider Markov chains whose transition rates are separable functions, which allows for an efficient low-rank tensor representation of the operator of this linear system. Typically, the right-hand side also has low-rank structure, and thus we can reduce the cost for computation and storage from exponential to linear. Previously known iterative methods also allow for low-rank approximations of the solution but are unable to guarantee that its entries sum up to one as required for a probability distribution. We derive a convergent iterative method using low-rank formats satisfying this condition. We also perform numerical experiments illustrating that the marginal distribution is well approximated with low rank.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/03/2019

On the convergence of Krylov methods with low-rank truncations

Low-rank Krylov methods are one of the few options available in the lite...
research
12/21/2021

Differentiated uniformization: A new method for inferring Markov chains on combinatorial state spaces including stochastic epidemic models

Motivation: We consider continuous-time Markov chains that describe the ...
research
08/03/2020

A parameter-dependent smoother for the multigrid method

The solution of parameter-dependent linear systems, by classical methods...
research
01/12/2021

Ergodic Exploration using Tensor Train: Applications in Insertion Tasks

By generating control policies that create natural search behaviors in a...
research
09/06/2020

Bayesian inversion for electromyography using low-rank tensor formats

The reconstruction of the structure of biological tissue using electromy...
research
09/27/2019

Identifying Low-Dimensional Structures in Markov Chains: A Nonnegative Matrix Factorization Approach

A variety of queries about stochastic systems boil down to study of Mark...
research
07/04/2019

Tensor methods for the computation of MTTA in large systems of loosely interconnected components

We are concerned with the computation of the mean-time-to-absorption (MT...

Please sign up or login with your details

Forgot password? Click here to reset