AutoAssign+: Automatic Shared Embedding Assignment in Streaming Recommendation

08/14/2023
by   Ziru Liu, et al.
0

In the domain of streaming recommender systems, conventional methods for addressing new user IDs or item IDs typically involve assigning initial ID embeddings randomly. However, this practice results in two practical challenges: (i) Items or users with limited interactive data may yield suboptimal prediction performance. (ii) Embedding new IDs or low-frequency IDs necessitates consistently expanding the embedding table, leading to unnecessary memory consumption. In light of these concerns, we introduce a reinforcement learning-driven framework, namely AutoAssign+, that facilitates Automatic Shared Embedding Assignment Plus. To be specific, AutoAssign+ utilizes an Identity Agent as an actor network, which plays a dual role: (i) Representing low-frequency IDs field-wise with a small set of shared embeddings to enhance the embedding initialization, and (ii) Dynamically determining which ID features should be retained or eliminated in the embedding table. The policy of the agent is optimized with the guidance of a critic network. To evaluate the effectiveness of our approach, we perform extensive experiments on three commonly used benchmark datasets. Our experiment results demonstrate that AutoAssign+ is capable of significantly enhancing recommendation performance by mitigating the cold-start problem. Furthermore, our framework yields a reduction in memory usage of approximately 20-30 effectiveness and efficiency for streaming recommender systems.

READ FULL TEXT

page 18

page 20

research
03/14/2023

CoMeta: Enhancing Meta Embeddings with Collaborative Information in Cold-start Problem of Recommendation

The cold-start problem is quite challenging for existing recommendation ...
research
02/26/2020

AutoEmb: Automated Embedding Dimensionality Search in Streaming Recommendations

Deep learning based recommender systems (DLRSs) often have embedding lay...
research
05/11/2021

Learning to Warm Up Cold Item Embeddings for Cold-start Recommendation with Meta Scaling and Shifting Networks

Recently, embedding techniques have achieved impressive success in recom...
research
08/15/2023

Dynamic Embedding Size Search with Minimum Regret for Streaming Recommender System

With the continuous increase of users and items, conventional recommende...
research
02/03/2023

Clustered Embedding Learning for Recommender Systems

In recent years, recommender systems have advanced rapidly, where embedd...
research
06/04/2021

Learning Elastic Embeddings for Customizing On-Device Recommenders

In today's context, deploying data-driven services like recommendation o...
research
07/14/2023

Streaming CTR Prediction: Rethinking Recommendation Task for Real-World Streaming Data

The Click-Through Rate (CTR) prediction task is critical in industrial r...

Please sign up or login with your details

Forgot password? Click here to reset