Liesel: A Probabilistic Programming Framework for Developing Semi-Parametric Regression Models and Custom Bayesian Inference Algorithms

09/22/2022
by   Hannes Riebl, et al.
0

Liesel is a probabilistic programming framework focusing on but not limited to semi-parametric regression. It comprises a graph-based model building library, a Markov chain Monte Carlo (MCMC) library with support for modular inference algorithms combining multiple kernels (both implemented in Python), and an R interface (RLiesel) for the configuration of semi-parametric regression models. Each component can be used independently of the others, e.g. the MCMC library also works with third-party model implementations. Our goal with Liesel is to facilitate a new research workflow in computational statistics: In a first step, the researcher develops a model graph with pre-implemented and well-tested building blocks as a base model, e.g. using RLiesel. Then, the graph can be manipulated to incorporate new research ideas, before the MCMC library can be used to run and analyze a default or user-defined MCMC procedure. The researcher has the option to combine powerful MCMC algorithms such as the No U-Turn Sampler (NUTS) with self-written kernels. Various tools for chain post-processing and diagnostics are also provided. Considering all its components, Liesel enables efficient and reliable statistical research on complex models and estimation algorithms. It depends on JAX as a numerical computing library. This way, it can benefit from the latest machine learning technology such as automatic differentiation, just-in-time (JIT) compilation, and the use of high-performance computing devices such as tensor processing units (TPUs).

READ FULL TEXT
research
10/01/2020

Fast fully-reproducible serial/parallel Monte Carlo and MCMC simulations and visualizations via ParaMonte::Python library

ParaMonte::Python (standing for Parallel Monte Carlo in Python) is a ser...
research
12/16/2014

Testing MCMC code

Markov Chain Monte Carlo (MCMC) algorithms are a workhorse of probabilis...
research
06/30/2020

Involutive MCMC: a Unifying Framework

Markov Chain Monte Carlo (MCMC) is a computational approach to fundament...
research
11/02/2022

Nonparametric Involutive Markov Chain Monte Carlo

A challenging problem in probabilistic programming is to develop inferen...
research
11/18/2019

emcee v3: A Python ensemble sampling toolkit for affine-invariant MCMC

emcee is a Python library implementing a class of affine-invariant ensem...
research
02/27/2011

Instant Replay: Investigating statistical Analysis in Sports

Technology has had an unquestionable impact on the way people watch spor...
research
01/14/2020

FunMC: A functional API for building Markov Chains

Constant-memory algorithms, also loosely called Markov chains, power the...

Please sign up or login with your details

Forgot password? Click here to reset