Learning transport cost from subset correspondence

09/29/2019
by   Ruishan Liu, et al.
12

Learning to align multiple datasets is an important problem with many applications, and it is especially useful when we need to integrate multiple experiments or correct for confounding. Optimal transport (OT) is a principled approach to align datasets, but a key challenge in applying OT is that we need to specify a transport cost function that accurately captures how the two datasets are related. Reliable cost functions are typically not available and practitioners often resort to using hand-crafted or Euclidean cost even if it may not be appropriate. In this work, we investigate how to learn the cost function using a small amount of side information which is often available. The side information we consider captures subset correspondence---i.e. certain subsets of points in the two data sets are known to be related. For example, we may have some images labeled as cars in both datasets; or we may have a common annotated cell type in single-cell data from two batches. We develop an end-to-end optimizer (OT-SI) that differentiates through the Sinkhorn algorithm and effectively learns the suitable cost function from side information. On systematic experiments in images, marriage-matching and single-cell RNA-seq, our method substantially outperform state-of-the-art benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2021

The Gene Mover's Distance: Single-cell similarity via Optimal Transport

This paper introduces the Gene Mover's Distance, a measure of similarity...
research
02/22/2020

Learning Cost Functions for Optimal Transport

Learning the cost function for optimal transport from observed transport...
research
07/15/2020

𝒲_∞-transport with discrete target as a combinatorial matching problem

In this short note, we show that given a cost function c, any coupling π...
research
09/29/2022

Rectified Flow: A Marginal Preserving Approach to Optimal Transport

We present a flow-based approach to the optimal transport (OT) problem b...
research
07/13/2011

Learning Hypergraph Labeling for Feature Matching

This study poses the feature correspondence problem as a hypergraph node...
research
03/21/2023

Efficiently Explaining CSPs with Unsatisfiable Subset Optimization (extended algorithms and examples)

We build on a recently proposed method for stepwise explaining solutions...
research
12/23/2020

Principled network extraction from images

Images of natural systems may represent patterns of network-like structu...

Please sign up or login with your details

Forgot password? Click here to reset