AdnFM: An Attentive DenseNet based Factorization Machine for CTR Prediction

by   Kai Wang, et al.

In this paper, we consider the Click-Through-Rate (CTR) prediction problem. Factorization Machines and their variants consider pair-wise feature interactions, but normally we won't do high-order feature interactions using FM due to high time complexity. Given the success of deep neural networks (DNNs) in many fields, researchers have proposed several DNN-based models to learn high-order feature interactions. Multi-layer perceptrons (MLP) have been widely employed to learn reliable mappings from feature embeddings to final logits. In this paper, we aim to explore more about these high-order features interactions. However, high-order feature interaction deserves more attention and further development. Inspired by the great achievements of Densely Connected Convolutional Networks (DenseNet) in computer vision, we propose a novel model called Attentive DenseNet based Factorization Machines (AdnFM). AdnFM can extract more comprehensive deep features by using all the hidden layers from a feed-forward neural network as implicit high-order features, then selects dominant features via an attention mechanism. Also, high-order interactions in the implicit way using DNNs are more cost-efficient than in the explicit way, for example in FM. Extensive experiments on two real-world datasets show that the proposed model can effectively improve the performance of CTR prediction.



page 1

page 2

page 3

page 4


xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems

Combinatorial features are essential for the success of many commercial ...

Generalized Embedding Machines for Recommender Systems

Factorization machine (FM) is an effective model for feature-based recom...

Disentangled Self-Attentive Neural Networks for Click-Through Rate Prediction

Click-through rate (CTR) prediction, which aims to predict the probabili...

Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling

As a well-established approach, factorization machine (FM) is capable of...

GateNet: Gating-Enhanced Deep Network for Click-Through Rate Prediction

Advertising and feed ranking are essential to many Internet companies su...

Dynamic Parameterized Network for CTR Prediction

Learning to capture feature relations effectively and efficiently is ess...

Alzheimer's Disease Diagnosis via Deep Factorization Machine Models

The current state-of-the-art deep neural networks (DNNs) for Alzheimer's...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.