DeepAI AI Chat
Log In Sign Up

Asymptotically Unambitious Artificial General Intelligence

by   Michael K. Cohen, et al.
University of Cincinnati
Australian National University

General intelligence, the ability to solve arbitrary solvable problems, is supposed by many to be artificially constructible. Narrow intelligence, the ability to solve a given particularly difficult problem, has seen impressive recent development. Notable examples include self-driving cars, Go engines, image classifiers, and translators. Artificial General Intelligence (AGI) presents dangers that narrow intelligence does not: if something smarter than us across every domain were indifferent to our concerns, it would be an existential threat to humanity, just as we threaten many species despite no ill will. Even the theory of how to maintain the alignment of an AGI's goals with our own has proven highly elusive. We present the first algorithm we are aware of for asymptotically unambitious AGI, where "unambitiousness" includes not seeking arbitrary power. Thus, we identify an exception to the Instrumental Convergence Thesis, which is roughly that by default, an AGI would seek power, including over us.


page 3

page 6

page 20


Asymptotically Optimal Agents

Artificial general intelligence aims to create agents capable of learnin...

A Framework for Searching for General Artificial Intelligence

There is a significant lack of unified approaches to building generally ...

The case for psychometric artificial general intelligence

A short review of the literature on measurement and detection of artific...

Chess AI: Competing Paradigms for Machine Intelligence

Endgame studies have long served as a tool for testing human creativity ...

Intelligence and Unambitiousness Using Algorithmic Information Theory

Algorithmic Information Theory has inspired intractable constructions of...

Towards Self-constructive Artificial Intelligence: Algorithmic basis (Part I)

Artificial Intelligence frameworks should allow for ever more autonomous...