The pathway elaboration method for mean first passage time estimation in large continuous-time Markov chains with applications to nucleic acid kinetics

01/11/2021
by   Sedigheh Zolaktaf, et al.
0

Continuous-time Markov chains (CTMCs) are widely used in many applications, including in modeling nucleic acid kinetics (non-equilibrium dynamics). A typical issue in CTMCs is that the number of states could be large, making mean first passage time (MFPT) estimation challenging, particularly for events that happen on a long time scale (rare events).We propose the pathway elaboration method, a time-efficient probabilistic truncation-based approach for detailed-balance CTMCs. It can be used for estimating the MFPT for rare events in addition to rapidly evaluating perturbed parameters without expensive recomputations. We demonstrate that pathway elaboration is suitable for predicting nucleic acid kinetics by conducting computational experiments on 267 measurements that cover a wide range of rates for different types of reactions. We utilize pathway elaboration to gain insight on the kinetics of two contrasting reactions, one being a rare event. We compare the performance of pathway elaboration with the stochastic simulation algorithm (SSA) for MFPT estimation on 237 of the reactions for which SSA is feasible. We further use pathway elaboration to rapidly evaluate perturbed model parameters during optimization with respect to experimentally measured rates for these 237 reactions. The testing error on the remaining 30 reactions, which involved rare events and were not feasible to simulate with SSA, improved comparably with the training error. Our framework and dataset are available at https://github.com/ DNA-and-Natural-Algorithms-Group/PathwayElaboration.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2021

Unbiased simulation of rare events in continuous time

For rare events described in terms of Markov processes, truly unbiased e...
research
05/26/2020

A reinforcement learning approach to rare trajectory sampling

Very often when studying non-equilibrium systems one is interested in an...
research
02/13/2023

Continuous-time convolutions model of event sequences

Massive samples of event sequences data occur in various domains, includ...
research
10/28/2019

Bounding Mean First Passage Times in Population Continuous-Time Markov Chains

We consider the problem of bounding mean first passage times for a class...
research
10/20/2020

Analysis of Markov Jump Processes under Terminal Constraints

Many probabilistic inference problems such as stochastic filtering or th...
research
02/16/2023

MM Algorithms to Estimate Parameters in Continuous-time Markov Chains

Continuous-time Markov chains (CTMCs) are popular modeling formalism tha...
research
12/21/2021

Differentiated uniformization: A new method for inferring Markov chains on combinatorial state spaces including stochastic epidemic models

Motivation: We consider continuous-time Markov chains that describe the ...

Please sign up or login with your details

Forgot password? Click here to reset