An Objective Laboratory Protocol for Evaluating Cognition of Non-Human Systems Against Human Cognition

02/17/2021
by   David J. Jilk, et al.
0

In this paper I describe and reduce to practice an objective protocol for evaluating the cognitive capabilities of a non-human system against human cognition in a laboratory environment. This is important because the existence of a non-human system with cognitive capabilities comparable to those of humans might make once-philosophical questions of safety and ethics immediate and urgent. Past attempts to devise evaluation methods, such as the Turing Test and many others, have not met this need; most of them either emphasize a single aspect of human cognition or a single theory of intelligence, fail to capture the human capacity for generality and novelty, or require success in the physical world. The protocol is broadly Bayesian, in that its primary output is a confidence statistic in relation to a claim. Further, it provides insight into the areas where and to what extent a particular system falls short of human cognition, which can help to drive further progress or precautions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2023

Can I say, now machines can think?

Generative AI techniques have opened the path for new generations of mac...
research
01/28/2020

Evaluation of the Handshake Turing Test for anthropomorphic Robots

Handshakes are fundamental and common greeting and parting gestures amon...
research
12/21/2022

A Cognitive Evaluation of Instruction Generation Agents tl;dr They Need Better Theory-of-Mind Capabilities

We mathematically characterize the cognitive capabilities that enable hu...
research
04/03/2017

Realizing an optimization approach inspired from Piagets theory on cognitive development

The objective of this paper is to introduce an artificial intelligence b...
research
06/04/2022

Symmetry as a Representation of Intuitive Geometry?

Recognition of geometrical patterns seems to be an important aspect of h...
research
06/15/2021

Physion: Evaluating Physical Prediction from Vision in Humans and Machines

While machine learning algorithms excel at many challenging visual tasks...
research
06/16/2012

Alan Turing and the "Hard" and "Easy" Problem of Cognition: Doing and Feeling

The "easy" problem of cognitive science is explaining how and why we can...

Please sign up or login with your details

Forgot password? Click here to reset