Encrypted accelerated least squares regression

03/02/2017
by   Pedro M. Esperança, et al.
0

Information that is stored in an encrypted format is, by definition, usually not amenable to statistical analysis or machine learning methods. In this paper we present detailed analysis of coordinate and accelerated gradient descent algorithms which are capable of fitting least squares and penalised ridge regression models, using data encrypted under a fully homomorphic encryption scheme. Gradient descent is shown to dominate in terms of encrypted computational speed, and theoretical results are proven to give parameter bounds which ensure correctness of decryption. The characteristics of encrypted computation are empirically shown to favour a non-standard acceleration technique. This demonstrates the possibility of approximating conventional statistical regression methods using encrypted data without compromising privacy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2023

Homomorphically encrypted gradient descent algorithms for quadratic programming

In this paper, we evaluate the different fully homomorphic encryption sc...
research
11/19/2020

Anderson acceleration of coordinate descent

Acceleration of first order methods is mainly obtained via inertial tech...
research
08/27/2015

Encrypted statistical machine learning: new privacy preserving methods

We present two new statistical machine learning methods designed to lear...
research
06/02/2020

Acceleration of Descent-based Optimization Algorithms via Carathéodory's Theorem

We propose a new technique to accelerate algorithms based on Gradient De...
research
12/05/2022

Encrypted machine learning of molecular quantum properties

Large machine learning models with improved predictions have become wide...
research
05/30/2019

Implicit Regularization of Accelerated Methods in Hilbert Spaces

We study learning properties of accelerated gradient descent methods for...
research
01/26/2019

A Practical Scheme for Two-Party Private Linear Least Squares

Privacy-preserving machine learning is learning from sensitive datasets ...

Please sign up or login with your details

Forgot password? Click here to reset