DeepAI AI Chat
Log In Sign Up

Follow the Prophet: Accurate Online Conversion Rate Prediction in the Face of Delayed Feedback

by   Haoming Li, et al.

The delayed feedback problem is one of the imperative challenges in online advertising, which is caused by the highly diversified feedback delay of a conversion varying from a few minutes to several days. It is hard to design an appropriate online learning system under these non-identical delay for different types of ads and users. In this paper, we propose to tackle the delayed feedback problem in online advertising by "Following the Prophet" (FTP for short). The key insight is that, if the feedback came instantly for all the logged samples, we could get a model without delayed feedback, namely the "prophet". Although the prophet cannot be obtained during online learning, we show that we could predict the prophet's predictions by an aggregation policy on top of a set of multi-task predictions, where each task captures the feedback patterns of different periods. We propose the objective and optimization approach for the policy, and use the logged data to imitate the prophet. Extensive experiments on three real-world advertising datasets show that our method outperforms the previous state-of-the-art baselines.


Multi-Head Online Learning for Delayed Feedback Modeling

In online advertising, it is highly important to predict the probability...

Handling many conversions per click in modeling delayed feedback

Predicting the expected value or number of post-click conversions (purch...

Predicting Different Types of Conversions with Multi-Task Learning in Online Advertising

Conversion prediction plays an important role in online advertising sinc...

A Unified Framework for Campaign Performance Forecasting in Online Display Advertising

Advertisers usually enjoy the flexibility to choose criteria like target...

A Nonparametric Delayed Feedback Model for Conversion Rate Prediction

Predicting conversion rates (CVRs) in display advertising (e.g., predict...

Online Multiclass Classification Based on Prediction Margin for Partial Feedback

We consider the problem of online multiclass classification with partial...