Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning

02/01/2022
by   Jin-Hyun Ahn, et al.
0

Federated learning (FL) has been intensively investigated in terms of communication efficiency, privacy, and fairness. However, efficient annotation, which is a pain point in real-world FL applications, is less studied. In this project, we propose to apply active learning (AL) and sampling strategy into the FL framework to reduce the annotation workload. We expect that the AL and FL can improve the performance of each other complementarily. In our proposed federated active learning (F-AL) method, the clients collaboratively implement the AL to obtain the instances which are considered as informative to FL in a distributed optimization manner. We compare the test accuracies of the global FL models using the conventional random sampling strategy, client-level separate AL (S-AL), and the proposed F-AL. We empirically demonstrate that the F-AL outperforms baseline methods in image classification tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/04/2022

Group Personalized Federated Learning

Federated learning (FL) can help promote data privacy by training a shar...
research
12/03/2022

GlueFL: Reconciling Client Sampling and Model Masking for Bandwidth Efficient Federated Learning

Federated learning (FL) is an effective technique to directly involve ed...
research
11/24/2022

Knowledge-Aware Federated Active Learning with Non-IID Data

Federated learning enables multiple decentralized clients to learn colla...
research
09/09/2021

Cartography Active Learning

We propose Cartography Active Learning (CAL), a novel Active Learning (A...
research
03/22/2023

Re-thinking Federated Active Learning based on Inter-class Diversity

Although federated learning has made awe-inspiring advances, most studie...
research
04/12/2023

Does Informativeness Matter? Active Learning for Educational Dialogue Act Classification

Dialogue Acts (DAs) can be used to explain what expert tutors do and wha...
research
03/14/2022

Communication-Efficient Federated Distillation with Active Data Sampling

Federated learning (FL) is a promising paradigm to enable privacy-preser...

Please sign up or login with your details

Forgot password? Click here to reset