DeepAI AI Chat
Log In Sign Up

Graph Construction from Data using Non Negative Kernel regression (NNK Graphs)

by   Sarath Shekkizhar, et al.

Data driven graph constructions are often used in various applications, including several machine learning tasks, where the goal is to make predictions and discover patterns. However, learning an optimal graph from data is still a challenging task. Weighted K-nearest neighbor and ϵ-neighborhood methods are among the most common graph construction methods, due to their computational simplicity but the choice of parameters such as K and ϵ associated with these methods is often ad hoc and lacks a clear interpretation. We formulate graph construction as the problem of finding a sparse signal approximation in kernel space, identifying key similarities between methods in signal approximation and existing graph learning methods. We propose non-negative kernel regression (NNK), an improved approach for graph construction with interesting geometric and theoretical properties. We show experimentally the efficiency of NNK graphs, its robustness to choice of sparsity K and better performance over state of the art graph methods in semi supervised learning tasks on real world data.


Semi-supervised Learning with Adaptive Neighborhood Graph Propagation Network

Graph Convolutional Networks (GCNs) have been widely studied for compact...

Study of Manifold Geometry using Multiscale Non-Negative Kernel Graphs

Modern machine learning systems are increasingly trained on large amount...

GLAM: Graph Learning by Modeling Affinity to Labeled Nodes for Graph Neural Networks

Graph Neural Networks have shown excellent performance on semi-supervise...

Fast Graph Neural Tangent Kernel via Kronecker Sketching

Many deep learning tasks have to deal with graphs (e.g., protein structu...

NNK-Means: Dictionary Learning using Non-Negative Kernel regression

An increasing number of systems are being designed by first gathering si...

Adversarial Regression with Doubly Non-negative Weighting Matrices

Many machine learning tasks that involve predicting an output response c...

Towards a Unified Theory of Light Spanners I: Fast (Yet Optimal) Constructions

Seminal works on light spanners over the years provide spanners with opt...