Can You Label Less by Using Out-of-Domain Data? Active Transfer Learning with Few-shot Instructions

11/21/2022
by   Rafal Kocielnik, et al.
32

Labeling social-media data for custom dimensions of toxicity and social bias is challenging and labor-intensive. Existing transfer and active learning approaches meant to reduce annotation effort require fine-tuning, which suffers from over-fitting to noise and can cause domain shift with small sample sizes. In this work, we propose a novel Active Transfer Few-shot Instructions (ATF) approach which requires no fine-tuning. ATF leverages the internal linguistic knowledge of pre-trained language models (PLMs) to facilitate the transfer of information from existing pre-labeled datasets (source-domain task) with minimum labeling effort on unlabeled target data (target-domain task). Our strategy can yield positive transfer achieving a mean AUC gain of 10.5 compared to no transfer with a large 22b parameter PLM. We further show that annotation of just a few target-domain samples via active learning can be beneficial for transfer, but the impact diminishes with more annotation effort (26 that not all transfer scenarios yield a positive gain, which seems related to the PLMs initial performance on the target-domain task.

READ FULL TEXT
research
05/11/2022

ReFine: Re-randomization before Fine-tuning for Cross-domain Few-shot Learning

Cross-domain few-shot learning (CD-FSL), where there are few target samp...
research
03/09/2023

Active Learning Based Domain Adaptation for Tissue Segmentation of Histopathological Images

Accurate segmentation of tissue in histopathological images can be very ...
research
06/09/2021

AutoFT: Automatic Fine-Tune for Parameters Transfer Learning in Click-Through Rate Prediction

Recommender systems are often asked to serve multiple recommendation sce...
research
04/01/2022

Efficient Argument Structure Extraction with Transfer Learning and Active Learning

The automation of extracting argument structures faces a pair of challen...
research
11/27/2022

Improving Low-Resource Question Answering using Active Learning in Multiple Stages

Neural approaches have become very popular in the domain of Question Ans...
research
10/06/2015

Active Transfer Learning with Zero-Shot Priors: Reusing Past Datasets for Future Tasks

How can we reuse existing knowledge, in the form of available datasets, ...
research
01/18/2022

Optimizing Active Learning for Low Annotation Budgets

When we can not assume a large amount of annotated data , active learnin...

Please sign up or login with your details

Forgot password? Click here to reset