DeepAI
Log In Sign Up

Ensemble- and Distance-Based Feature Ranking for Unsupervised Learning

11/23/2020
by   Matej Petković, et al.
0

In this work, we propose two novel (groups of) methods for unsupervised feature ranking and selection. The first group includes feature ranking scores (Genie3 score, RandomForest score) that are computed from ensembles of predictive clustering trees. The second method is URelief, the unsupervised extension of the Relief family of feature ranking algorithms. Using 26 benchmark data sets and 5 baselines, we show that both the Genie3 score (computed from the ensemble of extra trees) and the URelief method outperform the existing methods and that Genie3 performs best overall, in terms of predictive power of the top-ranked features. Additionally, we analyze the influence of the hyper-parameters of the proposed methods on their performance, and show that for the Genie3 score the highest quality is achieved by the most efficient parameter configuration. Finally, we propose a way of discovering the location of the features in the ranking, which are the most relevant in reality.

READ FULL TEXT
03/16/2020

Radiomic feature selection for lung cancer classifiers

Machine learning methods with quantitative imaging features integration ...
08/05/2020

Fuzzy Jaccard Index: A robust comparison of ordered lists

We propose Fuzzy Jaccard Index (FUJI) – a scale-invariant score for asse...
03/27/2022

Budget-Constrained Reinforcement of Ranked Objects

Commercial entries, such as hotels, are ranked according to score by a s...
05/06/2021

Learning Early Exit Strategies for Additive Ranking Ensembles

Modern search engine ranking pipelines are commonly based on large machi...
04/30/2020

Query-level Early Exit for Additive Learning-to-Rank Ensembles

Search engine ranking pipelines are commonly based on large ensembles of...
07/27/2017

A Family of Metrics for Clustering Algorithms

We give the motivation for scoring clustering algorithms and a metric M ...
09/07/2021

Optimizing model-agnostic Random Subspace ensembles

This paper presents a model-agnostic ensemble approach for supervised le...

Code Repositories

unsupervised_ranking

Enseble- and Distance-based Feature Ranking and Selection for Unsupervised Learning


view repo