BO-Muse: A human expert and AI teaming framework for accelerated experimental design

03/03/2023
by   Sunil Gupta, et al.
0

In this paper we introduce BO-Muse, a new approach to human-AI teaming for the optimization of expensive black-box functions. Inspired by the intrinsic difficulty of extracting expert knowledge and distilling it back into AI models and by observations of human behaviour in real-world experimental design, our algorithm lets the human expert take the lead in the experimental process. The human expert can use their domain expertise to its full potential, while the AI plays the role of a muse, injecting novelty and searching for areas of weakness to break the human out of over-exploitation induced by cognitive entrenchment. With mild assumptions, we show that our algorithm converges sub-linearly, at a rate faster than the AI or human alone. We validate our algorithm using synthetic data and with human experts performing real-world experiments.

READ FULL TEXT
research
12/06/2021

Making a Bird AI Expert Work for You and Me

As powerful as fine-grained visual classification (FGVC) is, responding ...
research
07/01/2022

Training Novices: The Role of Human-AI Collaboration and Knowledge Transfer

Across a multitude of work environments, expert knowledge is imperative ...
research
04/14/2023

Learning to Defer with Limited Expert Predictions

Recent research suggests that combining AI models with a human expert ca...
research
05/25/2022

A Human-Centric Assessment Framework for AI

With the rise of AI systems in real-world applications comes the need fo...
research
07/28/2022

Measuring Difficulty of Novelty Reaction

Current AI systems are designed to solve close-world problems with the a...
research
07/25/2019

Experimentation on the motion of an obstacle avoiding robot

An intelligent robot can be used for applications where a human is at si...
research
10/07/2015

Towards a general framework for an observation and knowledge based model of occupant behaviour in office buildings

This paper proposes a new general approach based on Bayesian networks to...

Please sign up or login with your details

Forgot password? Click here to reset