AIM: Automatic Interaction Machine for Click-Through Rate Prediction

11/05/2021
by   Chenxu Zhu, et al.
0

Feature embedding learning and feature interaction modeling are two crucial components of deep models for Click-Through Rate (CTR) prediction. Most existing deep CTR models suffer from the following three problems. First, feature interactions are either manually designed or simply enumerated. Second, all the feature interactions are modeled with an identical interaction function. Third, in most existing models, different features share the same embedding size which leads to memory inefficiency. To address these three issues mentioned above, we propose Automatic Interaction Machine (AIM) with three core components, namely, Feature Interaction Search (FIS), Interaction Function Search (IFS) and Embedding Dimension Search (EDS), to select significant feature interactions, appropriate interaction functions and necessary embedding dimensions automatically in a unified framework. Specifically, FIS component automatically identifies different orders of essential feature interactions with useless ones pruned; IFS component selects appropriate interaction functions for each individual feature interaction in a learnable way; EDS component automatically searches proper embedding size for each feature. Offline experiments on three large-scale datasets validate the superior performance of AIM. A three-week online A/B test in the recommendation service of a mainstream app market shows that AIM improves DeepFM model by 4.4 in terms of CTR.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2020

AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Prediction

Learning effective feature interactions is crucial for click-through rat...
research
12/16/2020

AutoDis: Automatic Discretization for Embedding Numerical Features in CTR Prediction

Learning sophisticated feature interactions is crucial for Click-Through...
research
01/26/2023

Optimizing Feature Set for Click-Through Rate Prediction

Click-through prediction (CTR) models transform features into latent vec...
research
04/03/2023

FinalMLP: An Enhanced Two-Stream MLP Model for CTR Prediction

Click-through rate (CTR) prediction is one of the fundamental tasks for ...
research
07/10/2019

Neural Input Search for Large Scale Recommendation Models

Recommendation problems with large numbers of discrete items, such as pr...
research
04/07/2022

Single-shot Embedding Dimension Search in Recommender System

As a crucial component of most modern deep recommender systems, feature ...
research
07/28/2020

COMET: Convolutional Dimension Interaction for Deep Matrix Factorization

Latent factor models play a dominant role among recommendation technique...

Please sign up or login with your details

Forgot password? Click here to reset