A* Tree Search for Portfolio Management

01/07/2019
by   Xiaojie Gao, et al.
0

We propose a planning-based method to teach an agent to manage portfolio from scratch. Our approach combines deep reinforcement learning techniques with search techniques like AlphaGo. By uniting the advantages in A* search algorithm with Monte Carlo tree search, we come up with a new algorithm named A* tree search in which best information is returned to guide next search. Also, the expansion mode of Monte Carlo tree is improved for a higher utilization of the neural network. The suggested algorithm can also optimize non-differentiable utility function by combinatorial search. This technique is then used in our trading system. The major component is a neural network that is trained by trading experiences from tree search and outputs prior probability to guide search by pruning away branches in turn. Experimental results on simulated and real financial data verify the robustness of the proposed trading system and the trading system produces better strategies than several approaches based on reinforcement learning.

READ FULL TEXT
research
06/12/2020

StarCraft II Build Order Optimization using Deep Reinforcement Learning and Monte-Carlo Tree Search

The real-time strategy game of StarCraft II has been posed as a challeng...
research
05/14/2020

Solve Traveling Salesman Problem by Monte Carlo Tree Search and Deep Neural Network

We present a self-learning approach that combines deep reinforcement lea...
research
01/30/2021

Deep Reinforcement Learning Aided Monte Carlo Tree Search for MIMO Detection

This paper proposes a novel multiple-input multiple-output (MIMO) symbol...
research
12/11/2021

Retrosynthetic Planning with Experience-Guided Monte Carlo Tree Search

Retrosynthetic planning problem is to analyze a complex molecule and giv...
research
02/28/2022

Monkey Business: Reinforcement learning meets neighborhood search for Virtual Network Embedding

In this article, we consider the Virtual Network Embedding (VNE) problem...
research
10/31/2019

Deep Reinforcement Learning-Based Topology Optimization for Self-Organized Wireless Sensor Networks

Wireless sensor networks (WSNs) are the foundation of the Internet of Th...

Please sign up or login with your details

Forgot password? Click here to reset