Sketching Meets Differential Privacy: Fast Algorithm for Dynamic Kronecker Projection Maintenance

10/20/2022
by   Zhao Song, et al.
0

Projection maintenance is one of the core data structure tasks. Efficient data structures for projection maintenance have led to recent breakthroughs in many convex programming algorithms. In this work, we further extend this framework to the Kronecker product structure. Given a constraint matrix A and a positive semi-definite matrix W∈ℝ^n× n with a sparse eigenbasis, we consider the task of maintaining the projection in the form of B^⊤( B B^⊤)^-1 B, where B= A(W⊗ I) or B= A(W^1/2⊗ W^1/2). At each iteration, the weight matrix W receives a low rank change and we receive a new vector h. The goal is to maintain the projection matrix and answer the query B^⊤( B B^⊤)^-1 Bh with good approximation guarantees. We design a fast dynamic data structure for this task and it is robust against an adaptive adversary. Following the work of [Beimel, Kaplan, Mansour, Nissim, Saranurak and Stemmer, STOC'22], we use tools from differential privacy to reduce the randomness required by the data structure and further improve the running time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2022

Dynamic Maintenance of Kernel Density Estimation Data Structure: From Practice to Theory

Kernel density estimation (KDE) stands out as a challenging task in mach...
research
10/08/2022

Dynamic Tensor Product Regression

In this work, we initiate the study of Dynamic Tensor Product Regression...
research
08/16/2022

New Parallel Order Maintenance Data Structure

The Order-Maintenance (OM) data structure maintains a total order list o...
research
04/16/2020

Faster Dynamic Matrix Inverse for Faster LPs

Motivated by recent Linear Programming solvers, we design dynamic data s...
research
09/03/2022

Differential Privacy on Dynamic Data

A fundamental problem in differential privacy is to release a privatized...
research
04/07/2022

Speeding Up Sparsification using Inner Product Search Data Structures

We present a general framework that utilizes different efficient data st...
research
10/26/2020

Unifying Matrix Data Structures: Simplifying and Speeding up Iterative Algorithms

Many algorithms use data structures that maintain properties of matrices...

Please sign up or login with your details

Forgot password? Click here to reset