Borel Kernels and their Approximation, Categorically

03/07/2018
by   Dahlqvist Fredrik, et al.
0

This paper introduces a categorical framework to study the exact and approximate semantics of probabilistic programs. We construct a dagger symmetric monoidal category of Borel kernels where the dagger-structure is given by Bayesian inversion. We show functorial bridges between this category and categories of Banach lattices which formalize the move from kernel-based semantics to predicate transformer (backward) or state transformer (forward) semantics. These bridges are related by natural transformations, and we show in particular that the Radon-Nikodym and Riesz representation theorems - two pillars of probability theory - define natural transformations. With the mathematical infrastructure in place, we present a generic and endogenous approach to approximating kernels on standard Borel spaces which exploits the involutive structure of our category of kernels. The approximation can be formulated in several equivalent ways by using the functorial bridges and natural transformations described above. Finally, we show that for sensible discretization schemes, every Borel kernel can be approximated by kernels on finite spaces, and that these approximations converge for a natural choice of topology. We illustrate the theory by showing two examples of how approximation can effectively be used in practice: Bayesian inference and the Kleene star operation of ProbNetKAT.

READ FULL TEXT
research
09/13/2023

Joint Distributions in Probabilistic Semantics

Various categories have been proposed as targets for the denotational se...
research
08/05/2022

A Fock space approach to the theory of strictly positive kernels

In this paper, we give a new approach to the theory of strictly positive...
research
09/17/2019

A Linear Exponential Comonad in s-finite Transition Kernels and Probabilistic Coherent Spaces

This paper concerns a stochastic construction of probabilistic coherent ...
research
05/18/2020

Weakest Preexpectation Semantics for Bayesian Inference

We present a semantics of a probabilistic while-language with soft condi...
research
05/10/2023

The Compositional Structure of Bayesian Inference

Bayes' rule tells us how to invert a causal process in order to update o...
research
01/23/2013

On Transformations between Probability and Spohnian Disbelief Functions

In this paper, we analyze the relationship between probability and Spohn...
research
09/29/2022

Dependent Bayesian Lenses: Categories of Bidirectional Markov Kernels with Canonical Bayesian Inversion

We generalise an existing construction of Bayesian Lenses to admit lense...

Please sign up or login with your details

Forgot password? Click here to reset