Kernel Embedding Linear Response

12/23/2019
by   He Zhang, et al.
0

In the paper, we study the problem of estimating linear response statistics under external perturbations using time series of unperturbed dynamics. A standard approach to this estimation problem is to employ the Fluctuation-Dissipation Theory, which, in turn, requires the knowledge of the functional form of the underlying unperturbed density that is not available in general. To overcome this issue, we consider a nonparametric density estimator formulated by the kernel embedding of distribution. To avoid the computational expense arises using radial type kernels, we consider the "Mercer-type" kernels constructed based on the classical orthogonal bases defined on non-compact domains, such as the Hermite and Laguerre polynomials. We establish the uniform convergence of the estimator, which justifies the use of the estimator for interpolation. Given a target function with a specific decaying property quantified by the available data, our framework allows one to choose the appropriate hypothesis space (an RKHS) that is "rich" enough for consistent estimation. For the linear response estimation, our study provides practical conditions for the well-posedness of both the estimator and the underlying response statistics. We offer a theoretical guarantee for the convergence of the estimator to the underlying actual linear response statistics. Finally, we provide a statistical error bound for the density estimation that accounts for the Monte-Carlo averaging over non-i.i.d time series and biases due to finite basis truncation. This error bound provides a mean to understand the feasibility as well as limitation of the kernel embedding with Mercer-type kernel. Numerically, we verify the effectiveness of the kernel embedding linear response estimator on two stochastic dynamics with known, yet, non-trivial equilibrium densities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/30/2019

Linear Response Based Parameter Estimation in the Presence of Model Error

Recently, we proposed a method to estimate parameters in stochastic dyna...
research
03/01/2015

Sparse Approximation of a Kernel Mean

Kernel means are frequently used to represent probability distributions ...
research
07/15/2011

Robust Kernel Density Estimation

We propose a method for nonparametric density estimation that exhibits r...
research
07/08/2020

Kernel-based Prediction of Non-Markovian Time Series

A nonparametric method to predict non-Markovian time series of partially...
research
07/13/2020

Strong Uniform Consistency with Rates for Kernel Density Estimators with General Kernels on Manifolds

We provide a strong uniform consistency result with the convergence rate...
research
11/10/2020

Efficient Interpolation of Density Estimators

We study the problem of space and time efficient evaluation of a nonpara...
research
11/01/2022

Recurrent Neural Networks and Universal Approximation of Bayesian Filters

We consider the Bayesian optimal filtering problem: i.e. estimating some...

Please sign up or login with your details

Forgot password? Click here to reset