Hyperparameter-free deep active learning for regression problems via query synthesis

01/29/2022
by   Simiao Ren, et al.
0

In the past decade, deep active learning (DAL) has heavily focused upon classification problems, or problems that have some 'valid' data manifolds, such as natural languages or images. As a result, existing DAL methods are not applicable to a wide variety of important problems – such as many scientific computing problems – that involve regression on relatively unstructured input spaces. In this work we propose the first DAL query-synthesis approach for regression problems. We frame query synthesis as an inverse problem and use the recently-proposed neural-adjoint (NA) solver to efficiently find points in the continuous input domain that optimize the query-by-committee (QBC) criterion. Crucially, the resulting NA-QBC approach removes the one sensitive hyperparameter of the classical QBC active learning approach - the "pool size"- making NA-QBC effectively hyperparameter free. This is significant because DAL methods can be detrimental, even compared to random sampling, if the wrong hyperparameters are chosen. We evaluate Random, QBC and NA-QBC sampling strategies on four regression problems, including two contemporary scientific computing problems. We find that NA-QBC achieves better average performance than random sampling on every benchmark problem, while QBC can be detrimental if the wrong hyperparameters are chosen.

READ FULL TEXT
research
01/31/2023

Deep Active Learning for Scientific Computing in the Wild

Deep learning (DL) is revolutionizing the scientific computing community...
research
01/30/2020

A Graph-Based Approach for Active Learning in Regression

Active learning aims to reduce labeling efforts by selectively asking hu...
research
04/14/2022

Active Learning for Regression and Classification by Inverse Distance Weighting

This paper proposes an active learning algorithm for solving regression ...
research
12/29/2021

Active Learning-Based Optimization of Scientific Experimental Design

Active learning (AL) is a machine learning algorithm that can achieve gr...
research
03/25/2023

Deep Kernel Methods Learn Better: From Cards to Process Optimization

The ability of deep learning methods to perform classification and regre...
research
12/04/2019

Active Learning of SVDD Hyperparameter Values

Support Vector Data Description is a popular method for outlier detectio...
research
06/01/2023

CS4ML: A general framework for active learning with arbitrary data based on Christoffel functions

We introduce a general framework for active learning in regression probl...

Please sign up or login with your details

Forgot password? Click here to reset