Automatic Differentiation via Effects and Handlers: An Implementation in Frank

01/20/2021
by   Jesse Sigal, et al.
0

Automatic differentiation (AD) is an important family of algorithms which enables derivative based optimization. We show that AD can be simply implemented with effects and handlers by doing so in the Frank language. By considering how our implementation behaves in Frank's operational semantics, we show how our code performs the dynamic creation of programs during evaluation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2021

A Brief Introduction to Automatic Differentiation for Machine Learning

Machine learning and neural network models in particular have been impro...
research
04/05/2021

AuTO: A Framework for Automatic differentiation in Topology Optimization

A critical step in topology optimization (TO) is finding sensitivities. ...
research
09/04/2019

Automatic Differentiation for Complex Valued SVD

In this note, we report the back propagation formula for complex valued ...
research
10/16/2022

Automatic Differentiation of Programs with Discrete Randomness

Automatic differentiation (AD), a technique for constructing new program...
research
04/04/2023

Automatic Differentiation of Binned Likelihoods With Roofit and Clad

RooFit is a toolkit for statistical modeling and fitting used by most ex...
research
03/22/2021

A Succinct Multivariate Lazy Multivariate Tower AD for Weil Algebra Computation

We propose a functional implementation of Multivariate Tower Automatic D...
research
09/21/2017

High-Performance Derivative Computations using CoDiPack

There are several AD tools available, which all implement different stra...

Please sign up or login with your details

Forgot password? Click here to reset