Differentiation of Blackbox Combinatorial Solvers

12/04/2019
by   Marin Vlastelica, et al.
19

Achieving fusion of deep learning with combinatorial algorithms promises transformative changes to artificial intelligence. One possible approach is to introduce combinatorial building blocks into neural networks. Such end-to-end architectures have the potential to tackle combinatorial problems on raw input data such as ensuring global consistency in multi-object tracking or route planning on maps in robotics. In this work, we present a method that implements an efficient backward pass through blackbox implementations of combinatorial solvers with linear objective functions. We provide both theoretical and experimental backing. In particular, we incorporate the Gurobi MIP solver, Blossom V algorithm, and Dijkstra's algorithm into architectures that extract suitable features from raw inputs for the traveling salesman problem, the min-cost perfect matching problem and the shortest path problem.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 12

page 14

page 15

research
03/25/2020

Deep Graph Matching via Blackbox Differentiation of Combinatorial Solvers

Building on recent progress at the intersection of combinatorial optimiz...
research
05/30/2022

Gradient Backpropagation Through Combinatorial Algorithms: Identity with Projection Works

Embedding discrete solvers as differentiable layers has given modern dee...
research
05/05/2021

CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints

Bridging logical and algorithmic reasoning with modern machine learning ...
research
02/15/2021

Neuro-algorithmic Policies enable Fast Combinatorial Generalization

Although model-based and model-free approaches to learning the control o...
research
05/04/2021

Neural Weighted A*: Learning Graph Costs and Heuristics with Differentiable Anytime A*

Recently, the trend of incorporating differentiable algorithms into deep...
research
02/03/2023

Coinductive guide to inductive transformer heads

We argue that all building blocks of transformer models can be expressed...
research
01/10/2022

Finding Shortest Path on a Terrain Surface by Using Finite Element Method

The solution of the shortest path problem on a surface is not only a the...

Please sign up or login with your details

Forgot password? Click here to reset