Random forests with random projections of the output space for high dimensional multi-label classification

04/14/2014
by   Arnaud Joly, et al.
0

We adapt the idea of random projections applied to the output space, so as to enhance tree-based ensemble methods in the context of multi-label classification. We show how learning time complexity can be reduced without affecting computational complexity and accuracy of predictions. We also show that random output space projections may be used in order to reach different bias-variance tradeoffs, over a broad panel of benchmark problems, and that this may lead to improved accuracy while reducing significantly the computational burden of the learning stage.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/25/2019

Random projections: data perturbation for classification problems

Random projections offer an appealing and flexible approach to a wide ra...
research
05/18/2019

Gradient tree boosting with random output projections for multi-label classification and multi-output regression

In many applications of supervised learning, multiple classification or ...
research
05/11/2017

Sketching Word Vectors Through Hashing

We propose a new fast word embedding technique using hash functions. The...
research
06/28/2018

Beyond One-hot Encoding: lower dimensional target embedding

Target encoding plays a central role when learning Convolutional Neural ...
research
12/31/2018

K-nearest Neighbor Search by Random Projection Forests

K-nearest neighbor (kNN) search has wide applications in many areas, inc...
research
06/18/2022

Bioinspired random projections for robust, sparse classification

Inspired by the use of random projections in biological sensing systems,...

Please sign up or login with your details

Forgot password? Click here to reset