Forgetting Fast in Recommender Systems

08/14/2022
by   Wenyan Liu, et al.
0

Users of a recommender system may want part of their data being deleted, not only from the data repository but also from the underlying machine learning model, for privacy or utility reasons. Such right-to-be-forgotten requests could be fulfilled by simply retraining the recommendation model from scratch, but that would be too slow and too expensive in practice. In this paper, we investigate fast machine unlearning techniques for recommender systems that can remove the effect of a small amount of training data from the recommendation model without incurring the full cost of retraining. A natural idea to speed this process up is to fine-tune the current recommendation model on the remaining training data instead of starting from a random initialization. This warm-start strategy indeed works for neural recommendation models using standard 1st-order neural network optimizers (like AdamW). However, we have found that even greater acceleration could be achieved by employing 2nd-order (Newton or quasi-Newton) optimization methods instead. To overcome the prohibitively high computational cost of 2nd-order optimizers, we propose a new recommendation unlearning approach AltEraser which divides the optimization problem of unlearning into many small tractable sub-problems. Extensive experiments on three real-world recommendation datasets show promising results of AltEraser in terms of consistency (forgetting thoroughness), accuracy (recommendation effectiveness), and efficiency (unlearning speed). To our knowledge, this work represents the first attempt at fast approximate machine unlearning for state-of-the-art neural recommendation models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2022

Making Recommender Systems Forget: Learning and Unlearning for Erasable Recommendation

Privacy laws and regulations enforce data-driven systems, e.g., recommen...
research
01/18/2022

Recommendation Unlearning

Recommender systems provide essential web services by learning users' pe...
research
07/24/2023

HeteFedRec: Federated Recommender Systems with Model Heterogeneity

Owing to the nature of privacy protection, federated recommender systems...
research
12/15/2020

FedeRank: User Controlled Feedback with Federated Recommender Systems

Recommender systems have shown to be a successful representative of how ...
research
06/09/2022

Comprehensive Fair Meta-learned Recommender System

In recommender systems, one common challenge is the cold-start problem, ...
research
08/15/2023

Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampening

Machine unlearning, the ability for a machine learning model to forget, ...
research
04/11/2022

PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems

The development of personalized recommendation has significantly improve...

Please sign up or login with your details

Forgot password? Click here to reset