Online Graph Dictionary Learning

02/12/2021
by   Cédric Vincent-Cuaz, et al.
0

Dictionary learning is a key tool for representation learning, that explains the data as linear combination of few basic elements. Yet, this analysis is not amenable in the context of graph learning, as graphs usually belong to different metric spaces. We fill this gap by proposing a new online Graph Dictionary Learning approach, which uses the Gromov Wasserstein divergence for the data fitting term. In our work, graphs are encoded through their nodes' pairwise relations and modeled as convex combination of graph atoms, i.e. dictionary elements, estimated thanks to an online stochastic algorithm, which operates on a dataset of unregistered graphs with potentially different number of nodes. Our approach naturally extends to labeled graphs, and is completed by a novel upper bound that can be used as a fast approximation of Gromov Wasserstein in the embedding space. We provide numerical evidences showing the interest of our approach for unsupervised embedding of graph datasets and for online graph subspace estimation and tracking.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/06/2021

Semi-relaxed Gromov Wasserstein divergence with applications on graphs

Comparing structured objects such as graphs is a fundamental operation i...
research
12/23/2015

Multi-centrality Graph Spectral Decompositions and their Application to Cyber Intrusion Detection

Many modern datasets can be represented as graphs and hence spectral dec...
research
10/21/2022

Geometric Sparse Coding in Wasserstein Space

Wasserstein dictionary learning is an unsupervised approach to learning ...
research
05/03/2016

Decentralized Dynamic Discriminative Dictionary Learning

We consider discriminative dictionary learning in a distributed online s...
research
10/12/2021

Data-driven Leak Localization in Water Distribution Networks via Dictionary Learning and Graph-based Interpolation

In this paper, we propose a data-driven leak localization method for wat...
research
03/29/2021

Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors

Transformer networks have revolutionized NLP representation learning sin...
research
06/22/2013

Online dictionary learning for kernel LMS. Analysis and forward-backward splitting algorithm

Adaptive filtering algorithms operating in reproducing kernel Hilbert sp...

Please sign up or login with your details

Forgot password? Click here to reset