Discrete Factorization Machines for Fast Feature-based Recommendation

05/06/2018
by   Han Liu, et al.
0

User and item features of side information are crucial for accurate recommendation. However, the large number of feature dimensions, e.g., usually larger than 10^7, results in expensive storage and computational cost. This prohibits fast recommendation especially on mobile applications where the computational resource is very limited. In this paper, we develop a generic feature-based recommendation model, called Discrete Factorization Machine (DFM), for fast and accurate recommendation. DFM binarizes the real-valued model parameters (e.g., float32) of every feature embedding into binary codes (e.g., boolean), and thus supports efficient storage and fast user-item score computation. To avoid the severe quantization loss of the binarization, we propose a convergent updating rule that resolves the challenging discrete optimization of DFM. Through extensive experiments on two real-world datasets, we show that 1) DFM consistently outperforms state-of-the-art binarized recommendation models, and 2) DFM shows very competitive performance compared to its real-valued version (FM), demonstrating the minimized quantization loss.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2019

Compositional Coding for Collaborative Filtering

Efficiency is crucial to the online recommender systems. Representing us...
research
06/23/2022

LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorization

Federated recommender system (FRS), which enables many local devices to ...
research
03/24/2020

Multi-Feature Discrete Collaborative Filtering for Fast Cold-start Recommendation

Hashing is an effective technique to address the large-scale recommendat...
research
12/03/2021

Towards Low-loss 1-bit Quantization of User-item Representations for Top-K Recommendation

Due to the promising advantages in space compression and inference accel...
research
11/05/2022

Deep Factorization Model for Robust Recommendation

Recently, malevolent user hacking has become a huge problem for real-wor...
research
04/05/2021

Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling

As a well-established approach, factorization machine (FM) is capable of...
research
05/27/2019

Learning In Practice: Reasoning About Quantization

There is a mismatch between the standard theoretical analyses of statist...

Please sign up or login with your details

Forgot password? Click here to reset