FedNAS: Federated Deep Learning via Neural Architecture Search

04/18/2020
by   Chaoyang He, et al.
24

Federated Learning (FL) has been proved to be an effective learning framework when data cannot be centralized due to privacy, communication costs, and regulatory restrictions. When training deep learning models under an FL setting, people employ the predefined model architecture discovered in the centralized environment. However, this predefined architecture may not be the optimal choice because it may not fit data with non-identical and independent distribution (non-IID). Thus, we advocate automating federated learning (AutoFL) to improve model accuracy and reduce the manual design effort. We specifically study AutoFL via Neural Architecture Search (NAS), which can automate the design process. We propose a Federated NAS (FedNAS) algorithm to help scattered workers collaboratively searching for a better architecture with higher accuracy. We also build a system based on FedNAS. Our experiments on non-IID dataset show that the architecture searched by FedNAS can outperform the manually predefined architecture.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/27/2021

SPIDER: Searching Personalized Neural Architecture for Federated Learning

Federated learning (FL) is an efficient learning framework that assists ...
research
10/13/2020

Direct Federated Neural Architecture Search

Neural Architecture Search (NAS) is a collection of methods to craft the...
research
05/11/2023

Divide-and-Conquer the NAS puzzle in Resource Constrained Federated Learning Systems

Federated Learning (FL) is a privacy-preserving distributed machine lear...
research
10/16/2022

FAQS: Communication-efficient Federate DNN Architecture and Quantization Co-Search for personalized Hardware-aware Preferences

Due to user privacy and regulatory restrictions, federate learning (FL) ...
research
09/12/2020

From Federated Learning to Federated Neural Architecture Search: A Survey

Federated learning is a recently proposed distributed machine learning p...
research
11/06/2020

FDNAS: Improving Data Privacy and Model Diversity in AutoML

To prevent the leakage of private information while enabling automated m...
research
04/09/2021

FL-AGCNS: Federated Learning Framework for Automatic Graph Convolutional Network Search

Recently, some Neural Architecture Search (NAS) techniques are proposed ...

Please sign up or login with your details

Forgot password? Click here to reset