Outsourcing Training without Uploading Data via Efficient Collaborative Open-Source Sampling

10/23/2022
by   Junyuan Hong, et al.
0

As deep learning blooms with growing demand for computation and data resources, outsourcing model training to a powerful cloud server becomes an attractive alternative to training at a low-power and cost-effective end device. Traditional outsourcing requires uploading device data to the cloud server, which can be infeasible in many real-world applications due to the often sensitive nature of the collected data and the limited communication bandwidth. To tackle these challenges, we propose to leverage widely available open-source data, which is a massive dataset collected from public and heterogeneous sources (e.g., Internet images). We develop a novel strategy called Efficient Collaborative Open-source Sampling (ECOS) to construct a proximal proxy dataset from open-source data for cloud training, in lieu of client data. ECOS probes open-source data on the cloud server to sense the distribution of client data via a communication- and computation-efficient sampling process, which only communicates a few compressed public features and client scalar responses. Extensive empirical studies show that the proposed ECOS improves the quality of automated client labeling, model compression, and label outsourcing when applied in various learning scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/18/2018

Expanding the Reach of Federated Learning by Reducing Client Resource Requirements

Communication on heterogeneous edge networks is a fundamental bottleneck...
research
03/19/2018

TOMAAT: volumetric medical image analysis as a cloud service

Deep learning has been recently applied to a multitude of computer visio...
research
03/25/2022

The TerraByte Client: providing access to terabytes of plant data

In this paper we demonstrate the TerraByte Client, a software to downloa...
research
07/22/2023

CloudScent: a model for code smell analysis in open-source cloud

The low cost and rapid provisioning capabilities have made open-source c...
research
05/30/2015

An Open Source Testing Tool for Evaluating Handwriting Input Methods

This paper presents an open source tool for testing the recognition accu...
research
03/26/2021

Distributed Client-Server Optimization for SLAM with Limited On-Device Resources

Simultaneous localization and mapping (SLAM) is a crucial functionality ...
research
02/17/2020

Computing in Covert Domain Using Data Hiding

This paper proposes an idea of data computing in the covert domain (DCCD...

Please sign up or login with your details

Forgot password? Click here to reset