Fitted Value Iteration Methods for Bicausal Optimal Transport

06/22/2023
by   Erhan Bayraktar, et al.
0

We develop a fitted value iteration (FVI) method to compute bicausal optimal transport (OT) where couplings have an adapted structure. Based on the dynamic programming formulation, FVI adopts a function class to approximate the value functions in bicausal OT. Under the concentrability condition and approximate completeness assumption, we prove the sample complexity using (local) Rademacher complexity. Furthermore, we demonstrate that multilayer neural networks with appropriate structures satisfy the crucial assumptions required in sample complexity proofs. Numerical experiments reveal that FVI outperforms linear programming and adapted Sinkhorn methods in scalability as the time horizon increases, while still maintaining acceptable accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2022

On the sample complexity of entropic optimal transport

We study the sample complexity of entropic optimal transport in high dim...
research
03/20/2022

Distributionally robust risk evaluation with causality constraint and structural information

This work studies distributionally robust evaluation of expected functio...
research
09/10/2019

Multi-Step Greedy and Approximate Real Time Dynamic Programming

Real Time Dynamic Programming (RTDP) is a well-known Dynamic Programming...
research
06/14/2020

Optimal Transport for Stationary Markov Chains via Policy Iteration

We study an extension of optimal transport techniques to stationary Mark...
research
02/16/2022

GAN Estimation of Lipschitz Optimal Transport Maps

This paper introduces the first statistically consistent estimator of th...
research
05/14/2008

Algorithms and Bounds for Rollout Sampling Approximate Policy Iteration

Several approximate policy iteration schemes without value functions, wh...
research
02/03/2022

Toric Geometry of Entropic Regularization

Entropic regularization is a method for large-scale linear programming. ...

Please sign up or login with your details

Forgot password? Click here to reset