Privacy-Preserving Machine Learning with Fully Homomorphic Encryption for Deep Neural Network

06/14/2021
by   Joon-Woo Lee, et al.
0

Fully homomorphic encryption (FHE) is one of the prospective tools for privacypreserving machine learning (PPML), and several PPML models have been proposed based on various FHE schemes and approaches. Although the FHE schemes are known as suitable tools to implement PPML models, previous PPML models on FHE encrypted data are limited to only simple and non-standard types of machine learning models. These non-standard machine learning models are not proven efficient and accurate with more practical and advanced datasets. Previous PPML schemes replace non-arithmetic activation functions with simple arithmetic functions instead of adopting approximation methods and do not use bootstrapping, which enables continuous homomorphic evaluations. Thus, they could not use standard activation functions and could not employ a large number of layers. The maximum classification accuracy of the existing PPML model with the FHE for the CIFAR-10 dataset was only 77 firstly implement the standard ResNet-20 model with the RNS-CKKS FHE with bootstrapping and verify the implemented model with the CIFAR-10 dataset and the plaintext model parameters. Instead of replacing the non-arithmetic functions with the simple arithmetic function, we use state-of-the-art approximation methods to evaluate these non-arithmetic functions, such as the ReLU, with sufficient precision [1]. Further, for the first time, we use the bootstrapping technique of the RNS-CKKS scheme in the proposed model, which enables us to evaluate a deep learning model on the encrypted data. We numerically verify that the proposed model with the CIFAR-10 dataset shows 98.67 data. The classification accuracy of the proposed model is 90.67 pretty close to that of the original ResNet-20 CNN model...

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

11/14/2017

CryptoDL: Deep Neural Networks over Encrypted Data

Machine learning algorithms based on deep neural networks have achieved ...
09/08/2020

Highly Accurate CNN Inference Using Approximate Activation Functions over Homomorphic Encryption

In the big data era, cloud-based machine learning as a service (MLaaS) h...
05/23/2021

Precise Approximation of Convolutional Neural Networks for Homomorphically Encrypted Data

Homomorphic encryption is one of the representative solutions to privacy...
07/29/2021

Blind Faith: Privacy-Preserving Machine Learning using Function Approximation

Over the past few years, a tremendous growth of machine learning was bro...
04/23/2020

ArchNet: Data Hiding Model in Distributed Machine Learning System

Cloud computing services has become the de facto standard technique for ...
06/25/2021

POLAR: A Polynomial Arithmetic Framework for Verifying Neural-Network Controlled Systems

We propose POLAR, a polynomial arithmetic framework that leverages polyn...
09/06/2021

FDFB: Full Domain Functional Bootstrapping Towards Practical Fully Homomorphic Encryption

Computation on ciphertexts of all known fully homomorphic encryption (FH...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.