A Scale-Independent Multi-Objective Reinforcement Learning with Convergence Analysis

02/08/2023
by   Mohsen Amidzadeh, et al.
0

Many sequential decision-making problems need optimization of different objectives which possibly conflict with each other. The conventional way to deal with a multi-task problem is to establish a scalar objective function based on a linear combination of different objectives. However, for the case of having conflicting objectives with different scales, this method needs a trial-and-error approach to properly find proper weights for the combination. As such, in most cases, this approach cannot guarantee an optimal Pareto solution. In this paper, we develop a single-agent scale-independent multi-objective reinforcement learning on the basis of the Advantage Actor-Critic (A2C) algorithm. A convergence analysis is then done for the devised multi-objective algorithm providing a convergence-in-mean guarantee. We then perform some experiments over a multi-task problem to evaluate the performance of the proposed algorithm. Simulation results show the superiority of developed multi-objective A2C approach against the single-objective algorithm.

READ FULL TEXT
research
03/17/2021

A Practical Guide to Multi-Objective Reinforcement Learning and Planning

Real-world decision-making tasks are generally complex, requiring trade-...
research
02/18/2020

MoTiAC: Multi-Objective Actor-Critics for Real-Time Bidding

Online real-time bidding (RTB) is known as a complex auction game where ...
research
04/13/2022

Modularity benefits reinforcement learning agents with competing homeostatic drives

The problem of balancing conflicting needs is fundamental to intelligenc...
research
08/08/2022

Improving performance in multi-objective decision-making in Bottles environments with soft maximin approaches

Balancing multiple competing and conflicting objectives is an essential ...
research
12/20/2018

Decentralized Decision-Making Over Multi-Task Networks

In important applications involving multi-task networks with multiple ob...
research
10/02/2019

Relationship Explainable Multi-objective Optimization Via Vector Value Function Based Reinforcement Learning

Solving multi-objective optimization problems is important in various ap...
research
04/08/2022

Multi-objective evolution for Generalizable Policy Gradient Algorithms

Performance, generalizability, and stability are three Reinforcement Lea...

Please sign up or login with your details

Forgot password? Click here to reset