A decentralized aggregation mechanism for training deep learning models using smart contract system for bank loan prediction

11/22/2020
by   Pratik Ratadiya, et al.
0

Data privacy and sharing has always been a critical issue when trying to build complex deep learning-based systems to model data. Facilitation of a decentralized approach that could take benefit from data across multiple nodes while not needing to merge their data contents physically has been an area of active research. In this paper, we present a solution to benefit from a distributed data setup in the case of training deep learning architectures by making use of a smart contract system. Specifically, we propose a mechanism that aggregates together the intermediate representations obtained from local ANN models over a blockchain. Training of local models takes place on their respective data. The intermediate representations derived from them, when combined and trained together on the host node, helps to get a more accurate system. While federated learning primarily deals with the same features of data where the number of samples being distributed on multiple nodes, here we are dealing with the same number of samples but with their features being distributed on multiple nodes. We consider the task of bank loan prediction wherein the personal details of an individual and their bank-specific details may not be available at the same place. Our aggregation mechanism helps to train a model on such existing distributed data without having to share and concatenate together the actual data values. The obtained performance, which is better than that of individual nodes, and is at par with that of a centralized data setup makes a strong case for extending our technique across other architectures and tasks. The solution finds its application in organizations that want to train deep learning models on vertically partitioned data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2023

iDML: Incentivized Decentralized Machine Learning

With the rising emergence of decentralized and opportunistic approaches ...
research
06/20/2022

Decentralized Distributed Learning with Privacy-Preserving Data Synthesis

In the medical field, multi-center collaborations are often sought to yi...
research
12/20/2021

Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity

Federated edge learning (FEEL) has attracted much attention as a privacy...
research
08/21/2023

Split Learning for Distributed Collaborative Training of Deep Learning Models in Health Informatics

Deep learning continues to rapidly evolve and is now demonstrating remar...
research
03/12/2021

SCEI: A Smart-Contract Driven Edge Intelligence Framework for IoT Systems

Federated learning (FL) utilizes edge computing devices to collaborative...
research
06/18/2019

Secure Architectures Implementing Trusted Coalitions for Blockchained Distributed Learning (TCLearn)

Distributed learning across a coalition of organizations allows the memb...
research
05/06/2019

Computing a Data Dividend

Quality data is a fundamental contributor to success in statistics and m...

Please sign up or login with your details

Forgot password? Click here to reset