Fully Robust Federated Submodel Learning in a Distributed Storage System

by   Zhusheng Wang, et al.

We consider the federated submodel learning (FSL) problem in a distributed storage system. In the FSL framework, the full learning model at the server side is divided into multiple submodels such that each selected client needs to download only the required submodel(s) and upload the corresponding update(s) in accordance with its local training data. The server comprises multiple independent databases and the full model is stored across these databases. An eavesdropper passively observes all the storage and listens to all the communicated data, of its controlled databases, to gain knowledge about the remote client data and the submodel information. In addition, a subset of databases may fail, negatively affecting the FSL process, as FSL process may take a non-negligible amount of time for large models. To resolve these two issues together (i.e., security and database repair), we propose a novel coding mechanism coined ramp secure regenerating coding (RSRC), to store the full model in a distributed manner. Using our new RSRC method, the eavesdropper is permitted to learn a controllable amount of submodel information for the sake of reducing the communication and storage costs. Further, during the database repair process, in the construction of the replacement database, the submodels to be updated are stored in the form of their latest version from updating clients, while the remaining submodels are obtained from the previous version in other databases through routing clients. Our new RSRC-based distributed FSL approach is constructed on top of our earlier two-database FSL scheme which uses private set union (PSU). A complete one-round FSL process consists of FSL-PSU phase, FSL-write phase and additional auxiliary phases. Our proposed FSL scheme is also robust against database drop-outs, client drop-outs, client late-arrivals and an active adversary controlling databases.


page 1

page 2

page 3

page 4


Private Federated Submodel Learning via Private Set Union

We consider the federated submodel learning (FSL) problem and propose an...

Information-Theoretically Private Federated Submodel Learning with Storage Constrained Databases

In federated submodel learning (FSL), a machine learning model is divide...

Private Read Update Write (PRUW) with Storage Constrained Databases

We investigate the problem of private read update write (PRUW) in relati...

Private Read Update Write (PRUW) With Heterogeneous Databases

We investigate the problem of private read update write (PRUW) with hete...

Distributed Transition Systems with Tags for Privacy Analysis

We present a logical framework that formally models how a given private ...

Graceful Forgetting II. Data as a Process

Data are rapidly growing in size and importance for society, a trend mot...

Data Consistency in Transactional Storage Systems: a Centralised Approach

Modern distributed databases weaken data consistency guarantees to allow...

Please sign up or login with your details

Forgot password? Click here to reset