CO-Optimal Transport

02/10/2020
by   Ivegen Redko, et al.
12

Optimal transport (OT) is a powerful geometric and probabilistic tool for finding correspondences and measuring similarity between two distributions. Yet, its original formulation relies on the existence of a cost function between the samples of the two distributions, which makes it impractical for comparing data distributions supported on different topological spaces. To circumvent this limitation, we propose a novel OT problem, named COOT for CO-Optimal Transport, that aims to simultaneously optimize two transport maps between both samples and features. This is different from other approaches that either discard the individual features by focussing on pairwise distances (e.g. Gromov-Wasserstein) or need to model explicitly the relations between the features. COOT leads to interpretable correspondences between both samples and feature representations and holds metric properties. We provide a thorough theoretical analysis of our framework and establish rich connections with the Gromov-Wasserstein distance. We demonstrate its versatility with two machine learning applications in heterogeneous domain adaptation and co-clustering/data summarization, where COOT leads to performance improvements over the competing state-of-the-art methods.

READ FULL TEXT

page 3

page 8

page 17

research
11/09/2020

A contribution to Optimal Transport on incomparable spaces

Optimal Transport is a theory that allows to define geometrical notions ...
research
10/01/2019

Training Generative Networks with general Optimal Transport distances

We propose a new algorithm that uses an auxiliary Neural Network to calc...
research
04/06/2022

The Self-Optimal-Transport Feature Transform

The Self-Optimal-Transport (SOT) feature transform is designed to upgrad...
research
06/19/2018

Statistical Optimal Transport via Geodesic Hubs

We propose a new method to estimate Wasserstein distances and optimal tr...
research
08/29/2018

Wasserstein is all you need

We propose a unified framework for building unsupervised representations...
research
02/11/2021

Unsupervised Ground Metric Learning using Wasserstein Eigenvectors

Optimal Transport (OT) defines geometrically meaningful "Wasserstein" di...
research
02/07/2020

Geometric Dataset Distances via Optimal Transport

The notion of task similarity is at the core of various machine learning...

Please sign up or login with your details

Forgot password? Click here to reset