On the universality of cognitive tests

05/09/2013
by   David L. Dowe, et al.
0

The analysis of the adaptive behaviour of many different kinds of systems such as humans, animals and machines, requires more general ways of assessing their cognitive abilities. This need is strengthened by increasingly more tasks being analysed for and completed by a wider diversity of systems, including swarms and hybrids. The notion of universal test has recently emerged in the context of machine intelligence evaluation as a way to define and use the same cognitive test for a variety of systems, using some principled tasks and adapting the interface to each particular subject. However, how far can universal tests be taken? This paper analyses this question in terms of subjects, environments, space-time resolution, rewards and interfaces. This leads to a number of findings, insights and caveats, according to several levels where universal tests may be progressively more difficult to conceive, implement and administer. One of the most significant contributions is given by the realisation that more universal tests are defined as maximisations of less universal tests for a variety of configurations. This means that universal tests must be necessarily adaptive.

READ FULL TEXT
research
05/07/2013

A short note on estimating intelligence from user profiles in the context of universal psychometrics: prospects and caveats

There has been an increasing interest in inferring some personality trai...
research
08/29/2014

AI Evaluation: past, present and future

Artificial intelligence develops techniques and systems whose performanc...
research
09/19/2012

Cognitive Bias for Universal Algorithmic Intelligence

Existing theoretical universal algorithmic intelligence models are not p...
research
03/19/2021

The reference distributions of Maurer's universal statistical test and its improved tests

Maurer's universal statistical test can widely detect non-randomness of ...
research
04/11/2015

Quantitative Analysis of Whether Machine Intelligence Can Surpass Human Intelligence

Whether the machine intelligence can surpass the human intelligence is a...
research
09/23/2011

Analysis of first prototype universal intelligence tests: evaluating and comparing AI algorithms and humans

Today, available methods that assess AI systems are focused on using emp...
research
11/06/2014

The Limitations of Standardized Science Tests as Benchmarks for Artificial Intelligence Research: Position Paper

In this position paper, I argue that standardized tests for elementary s...

Please sign up or login with your details

Forgot password? Click here to reset