Multi-Horizon Forecasting for Limit Order Books: Novel Deep Learning Approaches and Hardware Acceleration using Intelligent Processing Units

05/21/2021
by   Zihao Zhang, et al.
0

We design multi-horizon forecasting models for limit order book (LOB) data by using deep learning techniques. Unlike standard structures where a single prediction is made, we adopt encoder-decoder models with sequence-to-sequence and Attention mechanisms, to generate a forecasting path. Our methods achieve comparable performance to state-of-art algorithms at short prediction horizons. Importantly, they outperform when generating predictions over long horizons by leveraging the multi-horizon setup. Given that encoder-decoder models rely on recurrent neural layers, they generally suffer from a slow training process. To remedy this, we experiment with utilising novel hardware, so-called Intelligent Processing Units (IPUs) produced by Graphcore. IPUs are specifically designed for machine intelligence workload with the aim to speed up the computation process. We show that in our setup this leads to significantly faster training times when compared to training models with GPUs.

READ FULL TEXT

page 3

page 9

research
04/30/2019

Sequence to sequence deep learning models for solar irradiation forecasting

The energy output a photo voltaic(PV) panel is a function of solar irrad...
research
07/08/2022

Seasonal Encoder-Decoder Architecture for Forecasting

Deep learning (DL) in general and Recurrent neural networks (RNNs) in pa...
research
08/25/2021

Attention-based Neural Load Forecasting: A Dynamic Feature Selection Approach

Encoder-decoder-based recurrent neural network (RNN) has made significan...
research
06/17/2022

Accelerating Machine Learning Training Time for Limit Order Book Prediction

Financial firms are interested in simulation to discover whether a given...
research
04/21/2018

A Deep Learning Approach for Air Pollution Forecasting in South Korea Using Encoder-Decoder Networks & LSTM

Tackling air pollution is an imperative problem in South Korea, especial...
research
11/16/2020

Reinforced Medical Report Generation with X-Linear Attention and Repetition Penalty

To reduce doctors' workload, deep-learning-based automatic medical repor...
research
05/22/2023

Sequence-to-Sequence Forecasting-aided State Estimation for Power Systems

Power system state forecasting has gained more attention in real-time op...

Please sign up or login with your details

Forgot password? Click here to reset