Safe Transformative AI via a Windfall Clause

08/20/2021
by   Paolo Bova, et al.
4

Society could soon see transformative artificial intelligence (TAI). Models of competition for TAI show firms face strong competitive pressure to deploy TAI systems before they are safe. This paper explores a proposed solution to this problem, a Windfall Clause, where developers commit to donating a significant portion of any eventual extremely large profits to good causes. However, a key challenge for a Windfall Clause is that firms must have reason to join one. Firms must also believe these commitments are credible. We extend a model of TAI competition with a Windfall Clause to show how firms and policymakers can design a Windfall Clause which overcomes these challenges. Encouragingly, firms benefit from joining a Windfall Clause under a wide range of scenarios. We also find that firms join the Windfall Clause more often when the competition is more dangerous. Even when firms learn each other's capabilities, firms rarely wish to withdraw their support for the Windfall Clause. These three findings strengthen the case for using a Windfall Clause to promote the safe development of TAI.

READ FULL TEXT

page 11

page 14

page 16

page 19

research
12/07/2022

Artificial Intelligence Security Competition (AISC)

The security of artificial intelligence (AI) is an important research ar...
research
09/05/2023

Provably safe systems: the only path to controllable AGI

We describe a path to humanity safely thriving with powerful Artificial ...
research
03/27/2018

Generative Design in Minecraft (GDMC), Settlement Generation Competition

This paper introduces the settlement generation competition for Minecraf...
research
08/11/2021

Snakes AI Competition 2020 and 2021 Report

The Snakes AI Competition was held by the Innopolis University and was p...
research
08/20/2022

Safe Subjoins in Acyclic Joins

It is expensive to compute joins, often due to large intermediate relati...
research
09/01/2022

Possibilities and Implications of the Multi-AI Competition

The possibility of super-AIs taking over the world has been intensively ...
research
10/01/2020

Mediating Artificial Intelligence Developments through Negative and Positive Incentives

The field of Artificial Intelligence (AI) is going through a period of g...

Please sign up or login with your details

Forgot password? Click here to reset