Fast Graph Learning with Unique Optimal Solutions

by   Sami Abu-El-Haija, et al.

Graph Representation Learning (GRL) has been advancing at an unprecedented rate. However, many results rely on careful design and tuning of architectures, objectives, and training schemes. We propose efficient GRL methods that optimize convexified objectives with known closed form solutions. Guaranteed convergence to a global optimum releases practitioners from hyper-parameter and architecture tuning. Nevertheless, our proposed method achieves competitive or state-of-the-art performance on popular GRL tasks while providing orders of magnitude speedup. Although the design matrix (𝐌) of our objective is expensive to compute, we exploit results from random matrix theory to approximate solutions in linear time while avoiding an explicit calculation of 𝐌. Our code is online:


page 1

page 2

page 3

page 4


Accurate, Efficient and Scalable Training of Graph Neural Networks

Graph Neural Networks (GNNs) are powerful deep learning models to genera...

Revisiting Random Binning Features: Fast Convergence and Strong Parallelizability

Kernel method has been developed as one of the standard approaches for n...

NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search

In this paper, we propose an efficient NAS algorithm for generating task...

Efficient Algorithms for Bayesian Network Parameter Learning from Incomplete Data

We propose an efficient family of algorithms to learn the parameters of ...

Towards a Better Understanding of Linear Models for Recommendation

Recently, linear regression models, such as EASE and SLIM, have shown to...

Neural Bayes: A Generic Parameterization Method for Unsupervised Representation Learning

We introduce a parameterization method called Neural Bayes which allows ...

Efficient Gaussian Process Classification Using Polya-Gamma Data Augmentation

We propose an efficient stochastic variational approach to GP classifica...

Code Repositories


Functional TensorFlow Implementation of Singular Value Decomposition for paper Fast Graph Learning

view repo