Safe Transformative AI via a Windfall Clause

by   Paolo Bova, et al.

Society could soon see transformative artificial intelligence (TAI). Models of competition for TAI show firms face strong competitive pressure to deploy TAI systems before they are safe. This paper explores a proposed solution to this problem, a Windfall Clause, where developers commit to donating a significant portion of any eventual extremely large profits to good causes. However, a key challenge for a Windfall Clause is that firms must have reason to join one. Firms must also believe these commitments are credible. We extend a model of TAI competition with a Windfall Clause to show how firms and policymakers can design a Windfall Clause which overcomes these challenges. Encouragingly, firms benefit from joining a Windfall Clause under a wide range of scenarios. We also find that firms join the Windfall Clause more often when the competition is more dangerous. Even when firms learn each other's capabilities, firms rarely wish to withdraw their support for the Windfall Clause. These three findings strengthen the case for using a Windfall Clause to promote the safe development of TAI.



There are no comments yet.


page 11

page 14

page 16

page 19


Generative Design in Minecraft (GDMC), Settlement Generation Competition

This paper introduces the settlement generation competition for Minecraf...

Snakes AI Competition 2020 and 2021 Report

The Snakes AI Competition was held by the Innopolis University and was p...

Towards a Theory of Justice for Artificial Intelligence

This paper explores the relationship between artificial intelligence and...

DareFightingICE Competition: A Fighting Game Sound Design and AI Competition

This paper presents a new competition – at the 2022 IEEE Conference on G...

Structured access to AI capabilities: an emerging paradigm for safe AI deployment

Structured capability access ("SCA") is an emerging paradigm for the saf...

Formalizing IMO Problems and Solutions in Isabelle/HOL

The International Mathematical Olympiad (IMO) is perhaps the most celebr...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.