varrank: an R package for variable ranking based on mutual information with applications to observed systemic datasets

04/19/2018
by   Gilles Kratzer, et al.
4

This article describes the R package varrank. It has a flexible implementation of heuristic approaches which perform variable ranking based on mutual information. The package is particularly suitable for exploring multivariate datasets requiring a holistic analysis. The core functionality is a general implementation of the minimum redundancy maximum relevance (mRMRe) model. This approach is based on information theory metrics. It is compatible with discrete and continuous data which are discretised using a large choice of possible rules. The two main problems that can be addressed by this package are the selection of the most representative variables for modeling a collection of variables of interest, i.e., dimension reduction, and variable ranking with respect to a set of variables of interest.

READ FULL TEXT

page 7

page 8

page 11

page 18

research
07/04/2019

infotheory: A C++/Python package for multivariate information theoretic analysis

This paper introduces infotheory: a package that implements multivariate...
research
07/23/2021

On shared and multiple information

We address three outstanding problems in information theory. Problem one...
research
02/09/2020

A differentiable measure of pointwise shared information

Partial information decomposition (PID) of the multivariate mutual infor...
research
07/27/2018

IDTxl: The Information Dynamics Toolkit xl: a Python package for the efficient analysis of multivariate information dynamics in networks

The Information Dynamics Toolkit xl (IDTxl) is a comprehensive software ...
research
07/21/2022

Deep Sufficient Representation Learning via Mutual Information

We propose a mutual information-based sufficient representation learning...
research
02/07/2017

Trimming the Independent Fat: Sufficient Statistics, Mutual Information, and Predictability from Effective Channel States

One of the most fundamental questions one can ask about a pair of random...
research
05/25/2018

COREclust: a new package for a robust and scalable analysis of complex data

In this paper, we present a new R package COREclust dedicated to the det...

Please sign up or login with your details

Forgot password? Click here to reset