Nonmyopic Multiclass Active Search for Diverse Discovery

02/08/2022
by   Quan Nguyen, et al.
0

Active search is a setting in adaptive experimental design where we aim to uncover members of rare, valuable class(es) subject to a budget constraint. An important consideration in this problem is diversity among the discovered targets – in many applications, diverse discoveries offer more insight and may be preferable in downstream tasks. However, most existing active search policies either assume that all targets belong to a common positive class or encourage diversity via simple heuristics. We present a novel formulation of active search with multiple target classes, characterized by a utility function that naturally induces a preference for label diversity among discoveries via a diminishing returns mechanism. We then study this problem under the Bayesian lens and prove a hardness result for approximating the optimal policy. Finally, we propose an efficient, nonmyopic approximation to the optimal policy and demonstrate its superior empirical performance across a wide variety of experimental settings, including drug discovery.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/21/2018

Efficient nonmyopic active search with applications in drug and materials discovery

Active search is a learning paradigm for actively identifying as many me...
research
06/11/2021

Nonmyopic Multifidelity Active Search

Active search is a learning paradigm where we seek to identify as many m...
research
06/27/2012

Bayesian Optimal Active Search and Surveying

We consider two active binary-classification problems with atypical obje...
research
11/09/2019

Adaptivity in Adaptive Submodularity

Adaptive sequential decision making is one of the central challenges in ...
research
07/15/2023

An Empirical Study of the Effectiveness of Using a Replay Buffer on Mode Discovery in GFlowNets

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by...
research
12/03/2020

Optimal Policy Trees

We propose an approach for learning optimal tree-based prescription poli...

Please sign up or login with your details

Forgot password? Click here to reset