AdnFM: An Attentive DenseNet based Factorization Machine for CTR Prediction

12/20/2020
by   Kai Wang, et al.
0

In this paper, we consider the Click-Through-Rate (CTR) prediction problem. Factorization Machines and their variants consider pair-wise feature interactions, but normally we won't do high-order feature interactions using FM due to high time complexity. Given the success of deep neural networks (DNNs) in many fields, researchers have proposed several DNN-based models to learn high-order feature interactions. Multi-layer perceptrons (MLP) have been widely employed to learn reliable mappings from feature embeddings to final logits. In this paper, we aim to explore more about these high-order features interactions. However, high-order feature interaction deserves more attention and further development. Inspired by the great achievements of Densely Connected Convolutional Networks (DenseNet) in computer vision, we propose a novel model called Attentive DenseNet based Factorization Machines (AdnFM). AdnFM can extract more comprehensive deep features by using all the hidden layers from a feed-forward neural network as implicit high-order features, then selects dominant features via an attention mechanism. Also, high-order interactions in the implicit way using DNNs are more cost-efficient than in the explicit way, for example in FM. Extensive experiments on two real-world datasets show that the proposed model can effectively improve the performance of CTR prediction.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

03/14/2018

xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems

Combinatorial features are essential for the success of many commercial ...
02/16/2020

Generalized Embedding Machines for Recommender Systems

Factorization machine (FM) is an effective model for feature-based recom...
01/11/2021

Disentangled Self-Attentive Neural Networks for Click-Through Rate Prediction

Click-through rate (CTR) prediction, which aims to predict the probabili...
04/05/2021

Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling

As a well-established approach, factorization machine (FM) is capable of...
07/06/2020

GateNet: Gating-Enhanced Deep Network for Click-Through Rate Prediction

Advertising and feed ranking are essential to many Internet companies su...
11/09/2021

Dynamic Parameterized Network for CTR Prediction

Learning to capture feature relations effectively and efficiently is ess...
08/12/2021

Alzheimer's Disease Diagnosis via Deep Factorization Machine Models

The current state-of-the-art deep neural networks (DNNs) for Alzheimer's...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.