Model-based Reinforcement Learning for Predictions and Control for Limit Order Books

10/09/2019
by   Haoran Wei, et al.
0

We build a profitable electronic trading agent with Reinforcement Learning that places buy and sell orders in the stock market. An environment model is built only with historical observational data, and the RL agent learns the trading policy by interacting with the environment model instead of with the real-market to minimize the risk and potential monetary loss. Trained in unsupervised and self-supervised fashion, our environment model learned a temporal and causal representation of the market in latent space through deep neural networks. We demonstrate that the trading policy trained entirely within the environment model can be transferred back into the real market and maintain its profitability. We believe that this environment model can serve as a robust simulator that predicts market movement as well as trade impact for further studies.

READ FULL TEXT
research
01/20/2023

Asynchronous Deep Double Duelling Q-Learning for Trading-Signal Execution in Limit Order Book Markets

We employ deep reinforcement learning (RL) to train an agent to successf...
research
09/04/2023

ATMS: Algorithmic Trading-Guided Market Simulation

The effective construction of an Algorithmic Trading (AT) strategy often...
research
06/09/2023

Agent market orders representation through a contrastive learning approach

Due to the access to the labeled orders on the CAC40 data from Euronext,...
research
01/12/2022

The Recurrent Reinforcement Learning Crypto Agent

We demonstrate an application of online transfer learning as a digital a...
research
05/16/2018

Market Self-Learning of Signals, Impact and Optimal Trading: Invisible Hand Inference with Free Energy

We present a simple model of a non-equilibrium self-organizing market wh...
research
12/03/2021

Efficient Calibration of Multi-Agent Market Simulators from Time Series with Bayesian Optimization

Multi-agent market simulation is commonly used to create an environment ...
research
06/13/2022

Safe-FinRL: A Low Bias and Variance Deep Reinforcement Learning Implementation for High-Freq Stock Trading

In recent years, many practitioners in quantitative finance have attempt...

Please sign up or login with your details

Forgot password? Click here to reset