Decision Making Problems with Funnel Structure: A Multi-Task Learning Approach with Application to Email Marketing Campaigns

by   Ziping Xu, et al.

This paper studies the decision making problem with Funnel Structure. Funnel structure, a well-known concept in the marketing field, occurs in those systems where the decision maker interacts with the environment in a layered manner receiving far fewer observations from deep layers than shallow ones. For example, in the email marketing campaign application, the layers correspond to Open, Click and Purchase events. Conversions from Click to Purchase happen very infrequently because a purchase cannot be made unless the link in an email is clicked on. We formulate this challenging decision making problem as a contextual bandit with funnel structure and develop a multi-task learning algorithm that mitigates the lack of sufficient observations from deeper layers. We analyze both the prediction error and the regret of our algorithms. We verify our theory on prediction errors through a simple simulation. Experiments on both a simulated environment and an environment based on real-world data from a major email marketing company show that our algorithms offer significant improvement over previous methods.




Creating a spreadsheet is the simplest approach to schedule your LinkedIn updates Your schedule can be accommodated with the help of a spreadsheet. Create columns for the year, month, and day of the year to plan your postings. Just select the date and time that works best for you when scheduling your LinkedIn postings. You may even set the posting time to reflect when your audience is most likely to view it.


page 1

page 2

page 3

page 4


Navigating the Trade-Off between Multi-Task Learning and Learning to Multitask in Deep Neural Networks

The terms multi-task learning and multitasking are easily confused. Mult...

Multi-Task Learning for Contextual Bandits

Contextual bandits are a form of multi-armed bandit in which the agent h...

Weakly Supervised Multi-task Learning for Concept-based Explainability

In ML-aided decision-making tasks, such as fraud detection or medical di...

Thompson Sampling with a Mixture Prior

We study Thompson sampling (TS) in online decision-making problems where...

Self-fulfilling Bandits: Endogeneity Spillover and Dynamic Selection in Algorithmic Decision-making

In this paper, we study endogeneity problems in algorithmic decision-mak...

Multi-task Prediction of Patient Workload

Developing reliable workload predictive models can affect many aspects o...

Decentralized Decision-Making Over Multi-Task Networks

In important applications involving multi-task networks with multiple ob...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.