An architecture for the evaluation of intelligent systems

02/03/2011
by   Javier Insa-Cabrera, et al.
0

One of the main research areas in Artificial Intelligence is the coding of agents (programs) which are able to learn by themselves in any situation. This means that agents must be useful for purposes other than those they were created for, as, for example, playing chess. In this way we try to get closer to the pristine goal of Artificial Intelligence. One of the problems to decide whether an agent is really intelligent or not is the measurement of its intelligence, since there is currently no way to measure it in a reliable way. The purpose of this project is to create an interpreter that allows for the execution of several environments, including those which are generated randomly, so that an agent (a person or a program) can interact with them. Once the interaction between the agent and the environment is over, the interpreter will measure the intelligence of the agent according to the actions, states and rewards the agent has undergone inside the environment during the test. As a result we will be able to measure agents' intelligence in any possible environment, and to make comparisons between several agents, in order to determine which of them is the most intelligent. In order to perform the tests, the interpreter must be able to randomly generate environments that are really useful to measure agents' intelligence, since not any randomly generated environment will serve that purpose.

READ FULL TEXT
research
10/22/2019

Intelligence via ultrafilters: structural properties of some intelligence comparators of deterministic Legg-Hutter agents

Legg and Hutter, as well as subsequent authors, considered intelligent a...
research
12/03/2019

Measuring the intelligence of an idealized mechanical knowing agent

We define a notion of the intelligence level of an idealized mechanical ...
research
09/13/2019

Responsive Planning and Recognition for Closed-Loop Interaction

Many intelligent systems currently interact with others using at least o...
research
01/02/2016

An Improved Intelligent Agent for Mining Real-Time Databases Using Modified Cortical Learning Algorithms

Cortical Learning Algorithms based on the Hierarchical Temporal Memory, ...
research
09/18/2019

Reasoning in Highly Reactive Environments

The aim of my Ph.D. thesis concerns Reasoning in Highly Reactive Environ...
research
07/27/2022

Towards the Neuroevolution of Low-level Artificial General Intelligence

In this work, we argue that the search for Artificial General Intelligen...
research
04/17/2018

Terrain RL Simulator

We provide 89 challenging simulation environments that range in difficul...

Please sign up or login with your details

Forgot password? Click here to reset