Distributed Collaborative Hashing and Its Applications in Ant Financial

04/13/2018
by   Chaochao Chen, et al.
0

Collaborative filtering, especially latent factor model, has been popularly used in personalized recommendation. Latent factor model aims to learn user and item latent factors from user-item historic behaviors. To apply it into real big data scenarios, efficiency becomes the first concern, including offline model training efficiency and online recommendation efficiency. In this paper, we propose a Distributed Collaborative Hashing (DCH) model which can significantly improve both efficiencies. Specifically, we first propose a distributed learning framework, following the state-of-the-art parameter server paradigm, to learn the offline collaborative model. Our model can be learnt efficiently by distributedly computing subgradients in minibatches on workers and updating model parameters on servers asynchronously. We then adopt hashing technique to speedup the online recommendation procedure. Recommendation can be quickly made through exploiting lookup hash tables. We conduct thorough experiments on two real large-scale datasets. The experimental results demonstrate that, comparing with the classic and state-of-the-art (distributed) latent factor models, DCH has comparable performance in terms of recommendation accuracy but has both fast convergence speed in offline model training procedure and realtime efficiency in online recommendation procedure. Furthermore, the encouraging performance of DCH is also shown for several real-world applications in Ant Financial.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/14/2016

LLFR: A Lanczos-Based Latent Factor Recommender for Big Data Scenarios

The purpose if this master's thesis is to study and develop a new algori...
research
04/12/2020

Large-scale Real-time Personalized Similar Product Recommendations

Similar product recommendation is one of the most common scenes in e-com...
research
11/15/2021

Mitigating Divergence of Latent Factors via Dual Ascent for Low Latency Event Prediction Models

Real-world content recommendation marketplaces exhibit certain behaviors...
research
03/24/2020

Multi-Feature Discrete Collaborative Filtering for Fast Cold-start Recommendation

Hashing is an effective technique to address the large-scale recommendat...
research
05/09/2019

Compositional Coding for Collaborative Filtering

Efficiency is crucial to the online recommender systems. Representing us...
research
02/18/2018

HybridSVD: When Collaborative Information is Not Enough

We propose a hybrid algorithm for top-n recommendation task that allows ...
research
10/21/2022

Collaborative Image Understanding

Automatically understanding the contents of an image is a highly relevan...

Please sign up or login with your details

Forgot password? Click here to reset