k-Nearest Neighbors by Means of Sequence to Sequence Deep Neural Networks and Memory Networks

04/27/2018
by   Yiming Xu, et al.
0

k-Nearest Neighbors is one of the most fundamental but effective classification models. In this paper, we propose two families of models built on a sequence to sequence model and a memory network model to mimic the k-Nearest Neighbors model, which generate a sequence of labels, a sequence of out-of-sample feature vectors and a final label for classification, and thus they could also function as oversamplers. We also propose 'out-of-core' versions of our models which assume that only a small portion of data can be loaded into memory. Computational experiments show that our models outperform k-Nearest Neighbors due to the fact that our models must produce additional output and not just the label. As oversamples on imbalanced datasets, the models often outperform SMOTE and ADASYN.

READ FULL TEXT
research
06/10/2019

Label-Agnostic Sequence Labeling by Copying Nearest Neighbors

Retrieve-and-edit based approaches to structured prediction, where struc...
research
09/04/2022

A Novel Nearest Neighbors Algorithm Based on Power Muirhead Mean

This study aimed to propose a novel classifier based on K-Nearest Neighb...
research
02/22/2022

Wastewater Pipe Condition Rating Model Using K- Nearest Neighbors

Risk-based assessment in pipe condition mainly focuses on prioritizing t...
research
09/04/2017

Neural Distributed Autoassociative Memories: A Survey

Introduction. Neural network models of autoassociative, distributed memo...
research
04/20/2023

Flexible K Nearest Neighbors Classifier: Derivation and Application for Ion-mobility Spectrometry-based Indoor Localization

The K Nearest Neighbors (KNN) classifier is widely used in many fields s...
research
09/01/2021

Under-bagging Nearest Neighbors for Imbalanced Classification

In this paper, we propose an ensemble learning algorithm called under-ba...
research
08/15/2021

Deep Adversarially-Enhanced k-Nearest Neighbors

Recent works have theoretically and empirically shown that deep neural n...

Please sign up or login with your details

Forgot password? Click here to reset