State Space Emulation and Annealed Sequential Monte Carlo for High Dimensional Optimization

by   Chencheng Cai, et al.
Rutgers University

Many high dimensional optimization problems can be reformulated into a problem of finding theoptimal state path under an equivalent state space model setting. In this article, we present a general emulation strategy for developing a state space model whose likelihood function (or posterior distribution) shares the same general landscape as the objective function of the original optimization problem. Then the solution of the optimization problem is the same as the optimal state path that maximizes the likelihood function or the posterior distribution under the emulated system. To find such an optimal path, we adapt a simulated annealing approach by inserting a temperature control into the emulated dynamic system and propose a novel annealed Sequential Monte Carlo (SMC) method that effectively generating Monte Carlo sample paths utilizing samples obtained on the high temperature scale. Compared to the vanilla simulated annealing implementation, annealed SMC is an iterative algorithm for state space model optimization that directly generates state paths from the equilibrium distributions with a decreasing sequence of temperatures through sequential importance sampling which does not require burn-in or mixing iterations to ensure quasi-equilibrium condition. Several applications of state space model emulation and the corresponding annealed SMC results are demonstrated.


page 1

page 2

page 3

page 4


Efficient Likelihood-based Estimation via Annealing for Dynamic Structural Macrofinance Models

Most solved dynamic structural macrofinance models are non-linear and/or...

Discrete Equilibrium Sampling with Arbitrary Nonequilibrium Processes

We present a novel framework for performing statistical sampling, expect...

Precision annealing Monte Carlo methods for statistical data assimilation and machine learning

In statistical data assimilation (SDA) and supervised machine learning (...

The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction

This paper introduces the Sequential Monte Carlo Transformer, an origina...

Monte Carlo Methods for Tempo Tracking and Rhythm Quantization

We present a probabilistic generative model for timing deviations in exp...

Parallel Tempering on Optimized Paths

Parallel tempering (PT) is a class of Markov chain Monte Carlo algorithm...

Please sign up or login with your details

Forgot password? Click here to reset