Masked Transformer for Neighhourhood-aware Click-Through Rate Prediction

by   Erxue Min, et al.

Click-Through Rate (CTR) prediction, is an essential component of online advertising. The mainstream techniques mostly focus on feature interaction or user interest modeling, which rely on users' directly interacted items. The performance of these methods are usally impeded by inactive behaviours and system's exposure, incurring that the features extracted do not contain enough information to represent all potential interests. For this sake, we propose Neighbor-Interaction based CTR prediction, which put this task into a Heterogeneous Information Network (HIN) setting, then involves local neighborhood of the target user-item pair in the HIN to predict their linkage. In order to enhance the representation of the local neighbourhood, we consider four types of topological interaction among the nodes, and propose a novel Graph-masked Transformer architecture to effectively incorporates both feature and topological information. We conduct comprehensive experiments on two real world datasets and the experimental results show that our proposed method outperforms state-of-the-art CTR models significantly.



page 8


Dual Graph enhanced Embedding Neural Network for CTR Prediction

CTR prediction, which aims to estimate the probability that a user will ...

Relation-aware Heterogeneous Graph for User Profiling

User profiling has long been an important problem that investigates user...

Dynamic Sequential Graph Learning for Click-Through Rate Prediction

Click-through rate prediction plays an important role in the field of re...

HIEN: Hierarchical Intention Embedding Network for Click-Through Rate Prediction

Click-through rate (CTR) prediction plays an important role in online ad...

A Context-Aware User-Item Representation Learning for Item Recommendation

Both reviews and user-item interactions (i.e., rating scores) have been ...

Deep Structural Point Process for Learning Temporal Interaction Networks

This work investigates the problem of learning temporal interaction netw...

DemiNet: Dependency-Aware Multi-Interest Network with Self-Supervised Graph Learning for Click-Through Rate Prediction

In this paper, we propose a novel model named DemiNet (short for DEpende...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.