Extreme Regression for Dynamic Search Advertising

01/15/2020
by   Yashoteja Prabhu, et al.
6

This paper introduces a new learning paradigm called eXtreme Regression (XR) whose objective is to accurately predict the numerical degrees of relevance of an extremely large number of labels to a data point. XR can provide elegant solutions to many large-scale ranking and recommendation applications including Dynamic Search Advertising (DSA). XR can learn more accurate models than the recently popular extreme classifiers which incorrectly assume strictly binary-valued label relevances. Traditional regression metrics which sum the errors over all the labels are unsuitable for XR problems since they could give extremely loose bounds for the label ranking quality. Also, the existing regression algorithms won't efficiently scale to millions of labels. This paper addresses these limitations through: (1) new evaluation metrics for XR which sum only the k largest regression errors; (2) a new algorithm called XReg which decomposes XR task into a hierarchy of much smaller regression problems thus leading to highly efficient training and prediction. This paper also introduces a (3) new labelwise prediction algorithm in XReg useful for DSA and other recommendation tasks. Experiments on benchmark datasets demonstrated that XReg can outperform the state-of-the-art extreme classifiers as well as large-scale regressors and rankers by up to 50 up to 2 metric used in extreme classification and the click-through rate metric used in DSA respectively. Deployment of XReg on DSA in Bing resulted in a relative gain of 58 downloaded from http://manikvarma.org/code/Xreg/download.html.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/01/2021

DECAF: Deep Extreme Classification with Label Features

Extreme multi-label classification (XML) involves tagging a data point w...
research
10/20/2021

Propensity-scored Probabilistic Label Trees

Extreme multi-label classification (XMLC) refers to the task of tagging ...
research
07/31/2021

ECLARE: Extreme Classification with Label Graph Correlations

Deep extreme classification (XC) seeks to train deep architectures that ...
research
09/13/2021

Embedding Convolutions for Short Text Extreme Classification with Millions of Labels

Automatic annotation of short-text data to a large number of target labe...
research
02/11/2014

Ranking via Robust Binary Classification and Parallel Parameter Estimation in Large-Scale Data

We propose RoBiRank, a ranking algorithm that is motivated by observing ...
research
02/12/2023

Review of Extreme Multilabel Classification

Extreme multilabel classification or XML, in short, has emerged as a new...
research
03/04/2023

Learning Label Encodings for Deep Regression

Deep regression networks are widely used to tackle the problem of predic...

Please sign up or login with your details

Forgot password? Click here to reset