Consistent Regression using Data-Dependent Coverings

07/04/2019
by   Vincent Margot, et al.
0

In this paper, we introduce a novel method to generate interpretable regression function estimators. The idea is based on called data-dependent coverings. The aim is to extract from the data a covering of the feature space instead of a partition. The estimator predicts the empirical conditional expectation over the cells of the partitions generated from the coverings. Thus, such estimator has the same form as those issued from data-dependent partitioning algorithms. We give sufficient conditions to ensure the consistency, avoiding the sufficient condition of shrinkage of the cells that appears in the former literature. Doing so, we reduce the number of covering elements. We show that such coverings are interpretable and each element of the covering is tagged as significant or insignificant. The proof of the consistency is based on a control of the error of the empirical estimation of conditional expectations which is interesting on its own.

READ FULL TEXT
research
09/25/2012

Condition for neighborhoods in covering based rough sets to form a partition

Neighborhood is an important concept in covering based rough sets. That ...
research
07/10/2013

Applications of repeat degree on coverings of neighborhoods

In covering based rough sets, the neighborhood of an element is the inte...
research
01/20/2023

Almost everywhere continuity of conditional expectations

A necessary and sufficient condition on a sequence {𝔄_n}_n∈ℕ of σ-subalg...
research
08/22/2021

A universally consistent learning rule with a universally monotone error

We present a universally consistent learning rule whose expected error i...
research
05/04/2021

Estimating the conditional distribution in functional regression problems

We consider the problem of consistently estimating the conditional distr...
research
06/26/2020

Stochastic Approximation Algorithm for Estimating Mixing Distribution for Dependent Observations

Estimating the mixing density of a mixture distribution remains an inter...

Please sign up or login with your details

Forgot password? Click here to reset