Value Alignment Equilibrium in Multiagent Systems

09/16/2020
by   Nieves Montes, et al.
0

Value alignment has emerged in recent years as a basic principle to produce beneficial and mindful Artificial Intelligence systems. It mainly states that autonomous entities should behave in a way that is aligned with our human values. In this work, we summarize a previously developed model that considers values as preferences over states of the world and defines alignment between the governing norms and the values. We provide a use-case for this framework with the Iterated Prisoner's Dilemma model, which we use to exemplify the definitions we review. We take advantage of this use-case to introduce new concepts to be integrated with the established framework: alignment equilibrium and Pareto optimal alignment. These are inspired on the classical Nash equilibrium and Pareto optimality, but are designed to account for any value we wish to model in the system.

READ FULL TEXT
research
10/18/2021

Value alignment: a formal approach

principles that should govern autonomous AI systems. It essentially stat...
research
07/02/2022

The Linguistic Blind Spot of Value-Aligned Agency, Natural and Artificial

The value-alignment problem for artificial intelligence (AI) asks how we...
research
06/26/2019

Norms for Beneficial A.I.: A Computational Analysis of the Societal Value Alignment Problem

The rise of artificial intelligence (A.I.) based systems has the potenti...
research
05/12/2023

Multi-Value Alignment in Normative Multi-Agent System: Evolutionary Optimisation Approach

Value-alignment in normative multi-agent systems is used to promote a ce...
research
12/02/2020

Value Alignment Verification

As humans interact with autonomous agents to perform increasingly compli...
research
04/03/2017

Brief Notes on Hard Takeoff, Value Alignment, and Coherent Extrapolated Volition

I make some basic observations about hard takeoff, value alignment, and ...
research
09/26/2019

This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology

The explosion in the use of software in important sociotechnical systems...

Please sign up or login with your details

Forgot password? Click here to reset