DeepAI
Log In Sign Up

Optimal Learning for Sequential Decisions in Laboratory Experimentation

04/11/2020
by   Kris Reyes, et al.
0

The process of discovery in the physical, biological and medical sciences can be painstakingly slow. Most experiments fail, and the time from initiation of research until a new advance reaches commercial production can span 20 years. This tutorial is aimed to provide experimental scientists with a foundation in the science of making decisions. Using numerical examples drawn from the experiences of the authors, the article describes the fundamental elements of any experimental learning problem. It emphasizes the important role of belief models, which include not only the best estimate of relationships provided by prior research, previous experiments and scientific expertise, but also the uncertainty in these relationships. We introduce the concept of a learning policy, and review the major categories of policies. We then introduce a policy, known as the knowledge gradient, that maximizes the value of information from each experiment. We bring out the importance of reducing uncertainty, and illustrate this process for different belief models.

READ FULL TEXT

page 22

page 26

07/27/2020

From climate change to pandemics: decision science can help scientists have impact

Scientific knowledge and advances are a cornerstone of modern society. T...
09/27/2022

Decisions, decisions, decisions in an uncertain environment

Decision-makers abhor uncertainty, and it is certainly true that the les...
03/30/2020

Autonomous discovery in the chemical sciences part II: Outlook

This two-part review examines how automation has contributed to differen...
08/13/2017

Belief Tree Search for Active Object Recognition

Active Object Recognition (AOR) has been approached as an unsupervised l...
07/14/2021

Adaptability and the Pivot Penalty in Science

The ability to confront new questions, opportunities, and challenges is ...
12/26/2018

The Chaperone Effect in Scientific Publishing

Experience plays a critical role in crafting high impact scientific work...
04/10/2019

Trusted CI Experiences in Cybersecurity and Service to Open Science

This article describes experiences and lessons learned from the Trusted ...