L2P: An Algorithm for Estimating Heavy-tailed Outcomes

08/13/2019
by   Xindi Wang, et al.
0

Many real-world prediction tasks have outcome (a.k.a. target or response) variables that have characteristic heavy-tail distributions. Examples include copies of books sold, auction prices of art pieces, etc. By learning heavy-tailed distributions, "big and rare" instances (e.g., the best-sellers) will have accurate predictions. Most existing approaches are not dedicated to learning heavy-tailed distribution; thus, they heavily under-predict such instances. To tackle this problem, we introduce Learning to Place (L2P), which exploits the pairwise relationships between instances to learn from a proportionally higher number of rare instances. L2P consists of two stages. In Stage 1, L2P learns a pairwise preference classifier: is instance A > instance B?. In Stage 2, L2P learns to place a new instance into an ordinal ranking of known instances. Based on its placement, the new instance is then assigned a value for its outcome variable. Experiments on real data show that L2P outperforms competing approaches in terms of accuracy and capability to reproduce heavy-tailed outcome distribution. In addition, L2P can provide an interpretable model with explainable outcomes by placing each predicted instance in context with its comparable neighbors.

READ FULL TEXT
research
07/01/2023

Single-Stage Heavy-Tailed Food Classification

Deep learning based food image classification has enabled more accurate ...
research
07/19/2021

Heavy-tailed phase-type distributions: A unified approach

Heavy-tailed phase-type random variables have mathematically tractable d...
research
05/09/2014

Gaussian-Chain Filters for Heavy-Tailed Noise with Application to Detecting Big Buyers and Big Sellers in Stock Market

We propose a new heavy-tailed distribution --- Gaussian-Chain (GC) distr...
research
10/06/2020

Testing Tail Weight of a Distribution Via Hazard Rate

Understanding the shape of a distribution of data is of interest to peop...
research
02/20/2020

Heavy Tails Make Happy Buyers

In a second-price auction with i.i.d. (independent identically distribut...
research
02/22/2017

Heavy-Tailed Analogues of the Covariance Matrix for ICA

Independent Component Analysis (ICA) is the problem of learning a square...
research
05/27/2011

Learning to Order Things

There are many applications in which it is desirable to order rather tha...

Please sign up or login with your details

Forgot password? Click here to reset