PAC-Bayesian theory for stochastic LTI systems

03/23/2021
by   Deividas Eringis, et al.
0

In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems, including recurrent neural networks. In turn, PACBayesian error bounds are known to be useful for analyzing machine learning algorithms and for deriving new ones.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/29/2023

PAC-Bayesian bounds for learning LTI-ss systems with input from empirical loss

In this paper we derive a Probably Approxilmately Correct(PAC)-Bayesian ...
research
01/15/2014

Transductive Rademacher Complexity and its Applications

We develop a technique for deriving data-dependent error bounds for tran...
research
12/30/2022

PAC-Bayesian-Like Error Bound for a Class of Linear Time-Invariant Stochastic State-Space Models

In this paper we derive a PAC-Bayesian-Like error bound for a class of s...
research
06/30/2011

Explicit Learning Curves for Transduction and Application to Clustering and Compression Algorithms

Inductive learning is based on inferring a general rule from a finite da...
research
10/24/2022

A PAC-Bayesian Generalization Bound for Equivariant Networks

Equivariant networks capture the inductive bias about the symmetry of th...
research
10/18/2022

Optimisation Generalisation in Networks of Neurons

The goal of this thesis is to develop the optimisation and generalisatio...
research
02/07/2023

A unified recipe for deriving (time-uniform) PAC-Bayes bounds

We present a unified framework for deriving PAC-Bayesian generalization ...

Please sign up or login with your details

Forgot password? Click here to reset