Using Differentiable Programming for Flexible Statistical Modeling

12/07/2020
by   Maren Hackenberg, et al.
0

Differentiable programming has recently received much interest as a paradigm that facilitates taking gradients of computer programs. While the corresponding flexible gradient-based optimization approaches so far have been used predominantly for deep learning or enriching the latter with modeling components, we want to demonstrate that they can also be useful for statistical modeling per se, e.g., for quick prototyping when classical maximum likelihood approaches are challenging or not feasible. In an application from a COVID-19 setting, we utilize differentiable programming to quickly build and optimize a flexible prediction model adapted to the data quality challenges at hand. Specifically, we develop a regression model, inspired by delay differential equations, that can bridge temporal gaps of observations in the central German registry of COVID-19 intensive care cases for predicting future demand. With this exemplary modeling challenge, we illustrate how differentiable programming can enable simple gradient-based optimization of the model by automatic differentiation. This allowed us to quickly prototype a model under time pressure that outperforms simpler benchmark models. We thus exemplify the potential of differentiable programming also outside deep learning applications, to provide more options for flexible applied statistical modeling.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/08/2021

Differentiable Programming of Isometric Tensor Networks

Differentiable programming is a new programming paradigm which enables l...
research
10/04/2021

Differentiable Spline Approximations

The paradigm of differentiable programming has significantly enhanced th...
research
02/28/2022

Differentiable Matrix Elements with MadJax

MadJax is a tool for generating and evaluating differentiable matrix ele...
research
12/31/2020

Differentiable Programming à la Moreau

The notion of a Moreau envelope is central to the analysis of first-orde...
research
10/01/2019

DiffTaichi: Differentiable Programming for Physical Simulation

We study the problem of learning and optimizing through physical simulat...
research
08/31/2017

Differentiable cellular automata

We describe a class of cellular automata (CAs) that are end-to-end diffe...
research
06/25/2023

A differentiable Gaussian Prototype Layer for explainable Segmentation

We introduce a Gaussian Prototype Layer for gradient-based prototype lea...

Please sign up or login with your details

Forgot password? Click here to reset