JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for trading

08/25/2023
by   Sascha Frey, et al.
0

Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have previously been implemented in the context of agent-based models (ABMs), reinforcement learning (RL) environments, and generative models, processing order flows from historical data sets and hand-crafted agents alike. For many applications, there is a requirement for processing multiple books, either for the calibration of ABMs or for the training of RL agents. We showcase the first GPU-enabled LOB simulator designed to process thousands of books in parallel, with a notably reduced per-message processing time. The implementation of our simulator - JAX-LOB - is based on design choices that aim to best exploit the powers of JAX without compromising on the realism of LOB-related mechanisms. We integrate JAX-LOB with other JAX packages, to provide an example of how one may address an optimal execution problem with reinforcement learning, and to share some preliminary results from end-to-end RL training on GPUs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2022

Model-based gym environments for limit order book trading

Within the mathematical finance literature there is a rich catalogue of ...
research
01/20/2023

Asynchronous Deep Double Duelling Q-Learning for Trading-Signal Execution in Limit Order Book Markets

We employ deep reinforcement learning (RL) to train an agent to successf...
research
03/26/2022

Dynamic Noises of Multi-Agent Environments Can Improve Generalization: Agent-based Models meets Reinforcement Learning

We study the benefits of reinforcement learning (RL) environments based ...
research
11/09/2020

Reinforced Deep Markov Models With Applications in Automatic Trading

Inspired by the developments in deep generative models, we propose a mod...
research
06/21/2022

Imitate then Transcend: Multi-Agent Optimal Execution with Dual-Window Denoise PPO

A novel framework for solving the optimal execution and placement proble...
research
03/12/2021

Large Batch Simulation for Deep Reinforcement Learning

We accelerate deep reinforcement learning-based training in visually com...
research
11/01/2018

Horizon: Facebook's Open Source Applied Reinforcement Learning Platform

In this paper we present Horizon, Facebook's open source applied reinfor...

Please sign up or login with your details

Forgot password? Click here to reset