AI Chat AI Image Generator AI Video Text to Speech

SPlit: An Optimal Method for Data Splitting

12/20/2020

∙

by V. Roshan Joseph, et al.

∙

∙

In this article we propose an optimal method referred to as SPlit for splitting a dataset into training and testing sets. SPlit is based on the method of Support Points (SP), which was initially developed for finding the optimal representative points of a continuous distribution. We adapt SP for subsampling from a dataset using a sequential nearest neighbor algorithm. We also extend SP to deal with categorical variables so that SPlit can be applied to both regression and classification problems. The implementation of SPlit on real datasets shows substantial improvement in the worst-case testing performance for several modeling methods compared to the commonly used random splitting procedure.

V. Roshan Joseph
13 publications
Akhil Vakayil
3 publications

research

∙ 02/07/2022

Optimal Ratio for Data Splitting

It is common to split a dataset into training and testing sets before fi...

0 V. Roshan Joseph, et al. ∙

research

∙ 10/06/2021

Data Twinning

In this work, we develop a method named Twinning, for partitioning a dat...

0 Akhil Vakayil, et al. ∙

research

∙ 09/04/2022

Beyond Random Split for Assessing Statistical Model Performance

Even though a train/test split of the dataset randomly performed is a co...

5 Carlos Catania, et al. ∙

research

∙ 09/23/2022

I-SPLIT: Deep Network Interpretability for Split Computing

This work makes a substantial step in the field of split computing, i.e....

9 Federico Cunico, et al. ∙

research

∙ 09/24/2018

Equivalence Test in Multi-dimensional Space with Applications in A/B Testing

In this paper, we provide a statistical testing framework to check wheth...

0 Jing Miao, et al. ∙

research

∙ 03/19/2020

Homeostasis phenomenon in predictive inference when using a wrong learning model: a tale of random split of data into training and test sets

This note uses a conformal prediction procedure to provide further suppo...

0 Min-ge Xie, et al. ∙

research

∙ 02/21/2022

Inflation of test accuracy due to data leakage in deep learning-based classification of OCT images

In the application of deep learning on optical coherence tomography (OCT...

3 Iulian Emil Tampu, et al. ∙