The MacGyver Test - A Framework for Evaluating Machine Resourcefulness and Creative Problem Solving

04/26/2017
by   Vasanth Sarathy, et al.
0

Current measures of machine intelligence are either difficult to evaluate or lack the ability to test a robot's problem-solving capacity in open worlds. We propose a novel evaluation framework based on the formal notion of MacGyver Test which provides a practical way for assessing the resilience and resourcefulness of artificial agents.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/31/2022

Modeling social resilience: Questions, answers, open problems

Resilience denotes the capacity of a system to withstand shocks and its ...
research
10/22/2014

The Lovelace 2.0 Test of Artificial Creativity and Intelligence

Observing that the creation of certain types of artistic artifacts neces...
research
08/03/2020

A Standardized Radiograph-Agnostic Framework and Platform For Evaluating AI Radiological Systems

Radiology has been essential to accurately diagnosing diseases and asses...
research
06/06/2018

Can Machines Design? An Artificial General Intelligence Approach

Can machines design? Can they come up with creative solutions to problem...
research
02/26/2019

Unmasking Clever Hans Predictors and Assessing What Machines Really Learn

Current learning machines have successfully solved hard application prob...
research
08/14/2019

Evaluating Empathy in Artificial Agents

The novel research area of computational empathy is in its infancy and m...
research
02/01/2018

Edu-Edition Spreadsheet Competency Framework

Based on the Spreadsheet Competency Framework for finance professionals,...

Please sign up or login with your details

Forgot password? Click here to reset