MetAL: Active Semi-Supervised Learning on Graphs via Meta Learning

07/22/2020
by   Kaushalya Madhawa, et al.
0

The objective of active learning (AL) is to train classification models with less number of labeled instances by selecting only the most informative instances for labeling. The AL algorithms designed for other data types such as images and text do not perform well on graph-structured data. Although a few heuristics-based AL algorithms have been proposed for graphs, a principled approach is lacking. In this paper, we propose MetAL, an AL approach that selects unlabeled instances that directly improve the future performance of a classification model. For a semi-supervised learning problem, we formulate the AL task as a bilevel optimization problem. Based on recent work in meta-learning, we use the meta-gradients to approximate the impact of retraining the model with any unlabeled instance on the model performance. Using multiple graph datasets belonging to different domains, we demonstrate that MetAL efficiently outperforms existing state-of-the-art AL algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2020

Domain Generalization via Semi-supervised Meta Learning

The goal of domain generalization is to learn from multiple source domai...
research
01/30/2020

Fase-AL – Adaptation of Fast Adaptive Stacking of Ensembles for Supporting Active Learning

Classification algorithms to mine data stream have been extensively stud...
research
07/05/2020

Meta-Semi: A Meta-learning Approach for Semi-supervised Learning

Deep learning based semi-supervised learning (SSL) algorithms have led t...
research
10/07/2020

Robust Semi-Supervised Learning with Out of Distribution Data

Semi-supervised learning (SSL) based on deep neural networks (DNNs) has ...
research
04/08/2021

Relieving the Plateau: Active Semi-Supervised Learning for a Better Landscape

Deep learning (DL) relies on massive amounts of labeled data, and improv...
research
10/07/2021

Food Science Spectroscopy Model Training: Improving Data Efficiency Using Active Learning and Semi-Supervised Learning

The past decade witnesses a rapid development in the measurement and mon...
research
02/20/2023

Solving Recurrent MIPs with Semi-supervised Graph Neural Networks

We propose an ML-based model that automates and expedites the solution o...

Please sign up or login with your details

Forgot password? Click here to reset