Nonparametric Regression and Classification with Functional, Categorical, and Mixed Covariates

11/04/2021
by   Leonie Selk, et al.
0

We consider nonparametric prediction with multiple covariates, in particular categorical or functional predictors, or a mixture of both. The method proposed bases on an extension of the Nadaraya-Watson estimator where a kernel function is applied on a linear combination of distance measures each calculated on single covariates, with weights being estimated from the training data. The dependent variable can be categorical (binary or multi-class) or continuous, thus we consider both classification and regression problems. The methodology presented is illustrated and evaluated on artificial and real world data. Particularly it is observed that prediction accuracy can be increased, and irrelevant, noise variables can be identified/removed by "downgrading" the corresponding distance measures in a completely data-driven way.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/29/2022

Uniform convergence rates and automatic variabel selection in nonparametric regression with functional and categorical covariates

In Selk and Gertheiss (2022) a nonparametric prediction method for model...
research
07/20/2022

Learning Counterfactually Invariant Predictors

We propose a method to learn predictors that are invariant under counter...
research
01/12/2013

Multiple functional regression with both discrete and continuous covariates

In this paper we present a nonparametric method for extending functional...
research
10/25/2021

Sufficient reductions in regression with mixed predictors

Most data sets comprise of measurements on continuous and categorical va...
research
12/23/2022

Balanced Subsampling for Big Data with Categorical Covariates

The use and analysis of massive data are challenging due to the high sto...
research
10/11/2021

Nonparametric Functional Analysis of Generalized Linear Models Under Nonlinear Constraints

This article introduces a novel nonparametric methodology for Generalize...
research
05/17/2018

A Note on Coding and Standardization of Categorical Variables in (Sparse) Group Lasso Regression

Categorical regressor variables are usually handled by introducing a set...

Please sign up or login with your details

Forgot password? Click here to reset