Unsupervised Feature Construction for Improving Data Representation and Semantics

by   Marian-Andrei Rizoiu, et al.

Feature-based format is the main data representation format used by machine learning algorithms. When the features do not properly describe the initial data, performance starts to degrade. Some algorithms address this problem by internally changing the representation space, but the newly-constructed features are rarely comprehensible. We seek to construct, in an unsupervised way, new features that are more appropriate for describing a given dataset and, at the same time, comprehensible for a human user. We propose two algorithms that construct the new features as conjunctions of the initial primitive features or their negations. The generated feature sets have reduced correlations between features and succeed in catching some of the hidden relations between individuals in a dataset. For example, a feature like sky ∧ building ∧ panorama would be true for non-urban images and is more informative than simple features expressing the presence or the absence of an object. The notion of Pareto optimality is used to evaluate feature sets and to obtain a balance between total correlation and the complexity of the resulted feature set. Statistical hypothesis testing is used in order to automatically determine the values of the parameters used for constructing a data-dependent feature set. We experimentally show that our approaches achieve the construction of informative feature sets for multiple datasets.


page 3

page 12

page 13


A construction of UD k-ary multi-user codes from (2^m(k-1)+1)-ary codes for MAAC

In this paper, we proposed a construction of a UD k-ary T-user coding sc...

Deep Inverse Feature Learning: A Representation Learning of Error

This paper introduces a novel perspective about error in machine learnin...

SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions

Before applying data analytics or machine learning to a data set, a vita...

Consistent Feature Construction with Constrained Genetic Programming for Experimental Physics

A good feature representation is a determinant factor to achieve high pe...

On Image Classification: Correlation v.s. Causality

Image classification is one of the fundamental problems in computer visi...

ASAP-SML: An Antibody Sequence Analysis Pipeline Using Statistical Testing and Machine Learning

Antibodies are capable of potently and specifically binding individual a...

Correlation-based construction of neighborhood and edge features

Motivated by an abstract notion of low-level edge detector filters, we p...

Please sign up or login with your details

Forgot password? Click here to reset