A Sparse Deep Factorization Machine for Efficient CTR prediction

02/17/2020
by   Wei Deng, et al.
4

Click-through rate (CTR) prediction is a crucial task in online display advertising and the key part is to learn important feature interactions. The mainstream models are embedding-based neural networks that provide end-to-end training by incorporating hybrid components to model both low-order and high-order feature interactions. These models, however, slow down the prediction inference by at least hundreds of times due to the deep neural network (DNN) component. Considering the challenge of deploying embedding-based neural networks for online advertising, we propose to prune the redundant parameters for the first time to accelerate the inference and reduce the run-time memory usage. Most notably, we can accelerate the inference by 46X on Criteo dataset and 27X on Avazu dataset without loss on the prediction accuracy. In addition, the deep model acceleration makes an efficient model ensemble possible with low latency and significant gains on the performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2017

DeepFM: A Factorization-Machine based Neural Network for CTR Prediction

Learning sophisticated feature interactions behind user behaviors is cri...
research
08/11/2021

LightMove: A Lightweight Next-POI Recommendation for Taxicab Rooftop Advertising

Mobile digital billboards are an effective way to augment brand-awarenes...
research
06/09/2018

Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising

Click-through rate (CTR) prediction is a critical task in online display...
research
09/20/2022

Feature embedding in click-through rate prediction

We tackle the challenge of feature embedding for the purposes of improvi...
research
04/12/2018

DeepFM: An End-to-End Wide & Deep Learning Framework for CTR Prediction

Learning sophisticated feature interactions behind user behaviors is cri...
research
07/01/2018

Product-based Neural Networks for User Response Prediction over Multi-field Categorical Data

User response prediction is a crucial component for personalized informa...
research
12/04/2018

Unstructured Semantic Model supported Deep Neural Network for Click-Through Rate Prediction

With the rapid development of online advertising and recommendation syst...

Please sign up or login with your details

Forgot password? Click here to reset