A Roadmap for the Value-Loading Problem

09/04/2018
by   Lê Nguyên Hoang, et al.
0

We analyze the value-loading problem. This is the problem of encoding moral values into an AI agent interacting with a complex environment. Like many before, we argue that this is both a major concern and an extremely challenging problem. Solving it will likely require years, if not decades, of multidisciplinary work by teams of top scientists and experts. Given how uncertain the timeline of human-level AI research is, we thus argue that a pragmatic partial solution should be designed as soon as possible. To this end, we propose a preliminary research program. This roadmap identifies several key steps. We hope that this will allow scholars, engineers and decision-makers to better grasp the upcoming difficulties, and to foresee how they can best contribute to the global effort.

READ FULL TEXT
research
03/29/2021

"Weak AI" is Likely to Never Become "Strong AI", So What is its Greatest Value for us?

AI has surpassed humans across a variety of tasks such as image classifi...
research
01/01/2019

Personal Universes: A Solution to the Multi-Agent Value Alignment Problem

AI Safety researchers attempting to align values of highly capable intel...
research
12/08/2017

AI Safety and Reproducibility: Establishing Robust Foundations for the Neuropsychology of Human Values

We propose the creation of a systematic effort to identify and replicate...
research
03/19/2021

Lessons Learned from Educating AI Engineers

Over the past three years we have built a practice-oriented, bachelor le...
research
07/04/2022

Human-AI Guidelines in Practice: Leaky Abstractions as an Enabler in Collaborative Software Teams

In conventional software development, user experience (UX) designers and...
research
09/30/2021

SCIMAT: Science and Mathematics Dataset

In this work, we announce a comprehensive well curated and opensource da...
research
06/05/2023

Transformative AGI by 2043 is <1

This paper is a submission to the Open Philanthropy AI Worldviews Contes...

Please sign up or login with your details

Forgot password? Click here to reset