Adaptive Learning for Discovery

05/30/2022
by   Ziping Xu, et al.
0

In this paper, we study a sequential decision-making problem, called Adaptive Sampling for Discovery (ASD). Starting with a large unlabeled dataset, algorithms for ASD adaptively label the points with the goal to maximize the sum of responses. This problem has wide applications to real-world discovery problems, for example drug discovery with the help of machine learning models. ASD algorithms face the well-known exploration-exploitation dilemma. The algorithm needs to choose points that yield information to improve model estimates but it also needs to exploit the model. We rigorously formulate the problem and propose a general information-directed sampling (IDS) algorithm. We provide theoretical guarantees for the performance of IDS in linear, graph and low-rank models. The benefits of IDS are shown in both simulation experiments and real-data experiments for discovering chemical reaction conditions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2022

Thompson Sampling with Virtual Helping Agents

We address the problem of online sequential decision making, i.e., balan...
research
01/22/2020

GLIB: Exploration via Goal-Literal Babbling for Lifted Operator Learning

We address the problem of efficient exploration for learning lifted oper...
research
01/25/2018

Discovering Markov Blanket from Multiple interventional Datasets

In this paper, we study the problem of discovering the Markov blanket (M...
research
01/16/2023

An Efficient Approach for Discovering Graph Entity Dependencies (GEDs)

Graph entity dependencies (GEDs) are novel graph constraints, unifying k...
research
01/09/2019

Robust and Adaptive Planning under Model Uncertainty

Planning under model uncertainty is a fundamental problem across many ap...
research
04/17/2018

A Boosting Framework of Factorization Machine

Recently, Factorization Machines (FM) has become more and more popular f...
research
06/01/2023

Efficient Failure Pattern Identification of Predictive Algorithms

Given a (machine learning) classifier and a collection of unlabeled data...

Please sign up or login with your details

Forgot password? Click here to reset