Ordered Preference Elicitation Strategies for Supporting Multi-Objective Decision Making

02/21/2018
by   Luisa M Zintgraf, et al.
0

In multi-objective decision planning and learning, much attention is paid to producing optimal solution sets that contain an optimal policy for every possible user preference profile. We argue that the step that follows, i.e, determining which policy to execute by maximising the user's intrinsic utility function over this (possibly infinite) set, is under-studied. This paper aims to fill this gap. We build on previous work on Gaussian processes and pairwise comparisons for preference modelling, extend it to the multi-objective decision support scenario, and propose new ordered preference elicitation strategies based on ranking and clustering. Our main contribution is an in-depth evaluation of these strategies using computer and human-based experiments. We show that our proposed elicitation strategies outperform the currently used pairwise methods, and found that users prefer ranking most. Our experiments further show that utilising monotonicity information in GPs by using a linear prior mean at the start and virtual comparisons to the nadir and ideal points, increases performance. We demonstrate our decision support framework in a real-world study on traffic regulation, conducted with the city of Amsterdam.

READ FULL TEXT
research
11/16/2022

Addressing the issue of stochastic environments and local decision-making in multi-objective reinforcement learning

Multi-objective reinforcement learning (MORL) is a relatively new field ...
research
01/04/2017

Estimating Quality in Multi-Objective Bandits Optimization

Many real-world applications are characterized by a number of conflictin...
research
04/27/2018

Designing a cost-time-quality-efficient grinding process using MODM methods

In this paper a multi-objective mathematical model has been used to opti...
research
06/08/2023

Controllable Multi-Objective Re-ranking with Policy Hypernetworks

Multi-stage ranking pipelines have become widely used strategies in mode...
research
05/05/2021

Preference learning along multiple criteria: A game-theoretic perspective

The literature on ranking from ordinal data is vast, and there are sever...
research
01/18/2023

Sample-Efficient Multi-Objective Learning via Generalized Policy Improvement Prioritization

Multi-objective reinforcement learning (MORL) algorithms tackle sequenti...
research
03/05/2022

Boosting the Learning for Ranking Patterns

Discovering relevant patterns for a particular user remains a challengin...

Please sign up or login with your details

Forgot password? Click here to reset