Multi-Level Deep Cascade Trees for Conversion Rate Prediction

by   Hong Wen, et al.

Developing effective and efficient recommendation methods is very challenging for modern e-commerce platforms (e.g. Taobao). Generally speaking, two essential modules named "Click-Through Rate Prediction" (CTR) and "Conversion Rate Prediction" (CVR) are included, where CVR module is a crucial factor that affects the final purchasing volume directly. However, it is indeed very challenging due to its sparseness nature. In this paper, we tackle this problem by proposing multi-Level Deep Cascade Trees (ldcTree), which is a novel decision tree ensemble approach. It leverages deep cascade structures by stacking Gradient Boosting Decision Trees (GBDT) to effectively learn feature representation. In addition, we propose to utilize the cross-entropy in each tree of the preceding GBDT as the input feature representation for next level GBDT, which has a clear explanation, i.e., a traversal from root to leaf nodes in the next level GBDT corresponds to the combination of certain traversals in the preceding GBDT. The deep cascade structure and the combination rule enable the proposed ldcTree to have a stronger distributed feature representation ability. Moreover, inspired by ensemble learning, we propose an Ensemble ldcTree (E-ldcTree) to encourage the model's diversity and enhance the representation ability further. Finally, we propose an improved Feature learning method based on EldcTree (F-EldcTree) for taking adequate use of weak and strong correlation features identified by pre-trained GBDT models. Experimental results on off-line dataset and online deployment demonstrate the effectiveness of the proposed methods.


page 1

page 2

page 3

page 4


Entire Space Cascade Delayed Feedback Modeling for Effective Conversion Rate Prediction

Conversion rate (CVR) prediction is an essential task for large-scale e-...

Residual Networks Behave Like Boosting Algorithms

We show that Residual Networks (ResNet) is equivalent to boosting featur...

Efficient Fraud Detection using Deep Boosting Decision Trees

Fraud detection is to identify, monitor, and prevent potentially fraudul...

Interpreting Deep Learning Model Using Rule-based Method

Deep learning models are favored in many research and industry areas and...

Interpreting CNNs via Decision Trees

This paper presents a method to learn a decision tree to quantitatively ...

Dense Adaptive Cascade Forest: A Densely Connected Deep Ensemble for Classification Problems

Recent research has shown that deep ensemble for forest can achieve a hu...

GATE: Gated Additive Tree Ensemble for Tabular Classification and Regression

We propose a novel high-performance, parameter and computationally effic...

Please sign up or login with your details

Forgot password? Click here to reset