Learning Binarized Graph Representations with Multi-faceted Quantization Reinforcement for Top-K Recommendation

06/05/2022
by   Yankai Chen, et al.
0

Learning vectorized embeddings is at the core of various recommender systems for user-item matching. To perform efficient online inference, representation quantization, aiming to embed the latent features by a compact sequence of discrete numbers, recently shows the promising potentiality in optimizing both memory and computation overheads. However, existing work merely focuses on numerical quantization whilst ignoring the concomitant information loss issue, which, consequently, leads to conspicuous performance degradation. In this paper, we propose a novel quantization framework to learn Binarized Graph Representations for Top-K Recommendation (BiGeaR). BiGeaR introduces multi-faceted quantization reinforcement at the pre-, mid-, and post-stage of binarized representation learning, which substantially retains the representation informativeness against embedding binarization. In addition to saving the memory footprint, BiGeaR further develops solid online inference acceleration with bitwise operations, providing alternative flexibility for the realistic deployment. The empirical results over five large real-world benchmarks show that BiGeaR achieves about 22 the state-of-the-art quantization-based recommender system, and recovers about 95 with over 8x time and space reduction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/03/2021

Towards Low-loss 1-bit Quantization of User-item Representations for Top-K Recommendation

Due to the promising advantages in space compression and inference accel...
research
11/05/2019

Post-Training 4-bit Quantization on Embedding Tables

Continuous representations have been widely adopted in recommender syste...
research
10/22/2021

MIC: Model-agnostic Integrated Cross-channel Recommenders

Semantically connecting users and items is a fundamental problem for the...
research
05/20/2020

M2GRL: A Multi-task Multi-view Graph Representation Learning Framework for Web-scale Recommender Systems

Combining graph representation learning with multi-view data (side infor...
research
04/07/2023

Continuous Input Embedding Size Search For Recommender Systems

Latent factor models are the most popular backbones for today's recommen...
research
12/08/2022

TinyKG: Memory-Efficient Training Framework for Knowledge Graph Neural Recommender Systems

There has been an explosion of interest in designing various Knowledge G...
research
11/27/2020

Rethinking Generalization in American Sign Language Prediction for Edge Devices with Extremely Low Memory Footprint

Due to the boom in technical compute in the last few years, the world ha...

Please sign up or login with your details

Forgot password? Click here to reset