DeepAI
Log In Sign Up

Examining the Differential Risk from High-level Artificial Intelligence and the Question of Control

11/06/2022
by   Kyle A. Kilian, et al.
0

Artificial Intelligence (AI) is one of the most transformative technologies of the 21st century. The extent and scope of future AI capabilities remain a key uncertainty, with widespread disagreement on timelines and potential impacts. As nations and technology companies race toward greater complexity and autonomy in AI systems, there are concerns over the extent of integration and oversight of opaque AI decision processes. This is especially true in the subfield of machine learning (ML), where systems learn to optimize objectives without human assistance. Objectives can be imperfectly specified or executed in an unexpected or potentially harmful way. This becomes more concerning as systems increase in power and autonomy, where an abrupt capability jump could result in unexpected shifts in power dynamics or even catastrophic failures. This study presents a hierarchical complex systems framework to model AI risk and provide a template for alternative futures analysis. Survey data were collected from domain experts in the public and private sectors to classify AI impact and likelihood. The results show increased uncertainty over the powerful AI agent scenario, confidence in multiagent environments, and increased concern over AI alignment failures and influence-seeking behavior.

READ FULL TEXT

page 3

page 6

page 12

page 17

page 20

page 21

page 24

page 27

09/21/2022

Current and Near-Term AI as a Potential Existential Risk Factor

There is a substantial and ever-growing corpus of evidence and literatur...
07/15/2019

Classification Schemas for Artificial Intelligence Failures

In this paper we examine historical failures of artificial intelligence ...
06/16/2022

Is Power-Seeking AI an Existential Risk?

This report examines what I see as the core argument for concern about e...
02/11/2020

Artificial Intelligence Assistance Significantly Improves Gleason Grading of Prostate Biopsies by Pathologists

While the Gleason score is the most important prognostic marker for pros...
01/08/2023

AI Maintenance: A Robustness Perspective

With the advancements in machine learning (ML) methods and compute resou...
09/13/2020

Receptivity of an AI Cognitive Assistant by the Radiology Community: A Report on Data Collected at RSNA

Due to advances in machine learning and artificial intelligence (AI), a ...