On Parametric Optimal Execution and Machine Learning Surrogates

04/18/2022
by   Tao Chen, et al.
2

We investigate optimal execution problems with instantaneous price impact and stochastic resilience. First, in the setting of linear price impact function we derive a closed-form recursion for the optimal strategy, generalizing previous results with deterministic transient price impact. Second, we develop a numerical algorithm for the case of nonlinear price impact. We utilize an actor-critic framework that constructs two neural-network surrogates for the value function and the feedback control. One advantage of such functional approximators is the ability to do parametric learning, i.e. to incorporate some of the model parameters as part of the input space. Precise calibration of price impact, resilience, etc., is known to be extremely challenging and hence it is critical to understand sensitivity of the strategy to these parameters. Our parametric neural network (NN) learner organically scales across 3-6 input dimensions and is shown to accurately approximate optimal strategy across a range of parameter configurations. We provide a fully reproducible Jupyter Notebook with our NN implementation, which is of independent pedagogical interest, demonstrating the ease of use of NN surrogates in (parametric) stochastic control problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/12/2023

Statistical Learning with Sublinear Regret of Propagator Models

We consider a class of learning problems in which an agent liquidates a ...
research
02/22/2021

Actor-Critic Method for High Dimensional Static Hamilton–Jacobi–Bellman Partial Differential Equations based on Neural Networks

We propose a novel numerical method for high dimensional Hamilton–Jacobi...
research
06/04/2021

A Learning-based Optimal Market Bidding Strategy for Price-Maker Energy Storage

Load serving entities with storage units reach sizes and performances th...
research
09/08/2023

Actor critic learning algorithms for mean-field control with moment neural networks

We develop a new policy gradient and actor-critic algorithm for solving ...
research
09/06/2023

An Offline Learning Approach to Propagator Models

We consider an offline learning problem for an agent who first estimates...
research
10/28/2021

Learning to Control using Image Feedback

Learning to control complex systems using non-traditional feedback, e.g....
research
06/17/2020

Learning a functional control for high-frequency finance

We use a deep neural network to generate controllers for optimal trading...

Please sign up or login with your details

Forgot password? Click here to reset