DeepAI AI Chat
Log In Sign Up

Deep reinforcement learning for time series: playing idealized trading games

by   Xiang Gao, et al.

Deep Q-learning is investigated as an end-to-end solution to estimate the optimal strategies for acting on time series input. Experiments are conducted on two idealized trading games. 1) Univariate: the only input is a wave-like price time series, and 2) Bivariate: the input includes a random stepwise price time series and a noisy signal time series, which is positively correlated with future price changes. The Univariate game tests whether the agent can capture the underlying dynamics, and the Bivariate game tests whether the agent can utilize the hidden relation among the inputs. Stacked Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM) units, Convolutional Neural Network (CNN), and multi-layer perceptron (MLP) are used to model Q values. For both games, all agents successfully find a profitable strategy. The GRU-based agents show best overall performance in the Univariate game, while the MLP-based agents outperform others in the Bivariate game.


page 1

page 2

page 3

page 4


On Technical Trading and Social Media Indicators in Cryptocurrencies' Price Classification Through Deep Learning

This work aims to analyse the predictability of price movements of crypt...

Deep Gated Recurrent and Convolutional Network Hybrid Model for Univariate Time Series Classification

Hybrid LSTM-fully convolutional networks (LSTM-FCN) for time series clas...

Orthogonal Echo State Networks and stochastic evaluations of likelihoods

We report about probabilistic likelihood estimates that are performed on...

MambaNet: A Hybrid Neural Network for Predicting the NBA Playoffs

In this paper, we present Mambanet: a hybrid neural network for predicti...

Multi-Faceted Representation Learning with Hybrid Architecture for Time Series Classification

Time series classification problems exist in many fields and have been e...

Comprehensible Context-driven Text Game Playing

In order to train a computer agent to play a text-based computer game, w...

Code Repositories


Playing trading games with deep reinforcement learning

view repo