Higher-Order Minimum Cost Lifted Multicuts for Motion Segmentation

04/06/2017
by   Margret Keuper, et al.
0

Most state-of-the-art motion segmentation algorithms draw their potential from modeling motion differences of local entities such as point trajectories in terms of pairwise potentials in graphical models. Inference in instances of minimum cost multicut problems defined on such graphs al- lows to optimize the number of the resulting segments along with the segment assignment. However, pairwise potentials limit the discriminative power of the employed motion models to translational differences. More complex models such as Euclidean or affine transformations call for higher-order potentials and a tractable inference in the resulting higher-order graphical models. In this paper, we (1) introduce a generalization of the minimum cost lifted multicut problem to hypergraphs, and (2) propose a simple primal feasible heuristic that allows for a reasonably efficient inference in instances of higher-order lifted multicut problem instances defined on point trajectory hypergraphs for motion segmentation. The resulting motion segmentations improve over the state-of-the-art on the FBMS-59 dataset.

READ FULL TEXT

page 1

page 8

research
05/29/2018

Superpixel-enhanced Pairwise Conditional Random Field for Semantic Segmentation

Superpixel-based Higher-order Conditional Random Fields (CRFs) are effec...
research
05/28/2013

Higher-order Segmentation via Multicuts

Multicuts enable to conveniently represent discrete graphical models for...
research
05/16/2021

Uncertainty in Minimum Cost Multicuts for Image and Motion Segmentation

The minimum cost lifted multicut approach has proven practically good pe...
research
04/05/2018

A Multi-Layer Approach to Superpixel-based Higher-order Conditional Random Field for Semantic Image Segmentation

Superpixel-based Higher-order Conditional random fields (SP-HO-CRFs) are...
research
04/27/2020

Can We Learn Heuristics For Graphical Model Inference Using Reinforcement Learning?

Combinatorial optimization is frequently used in computer vision. For in...
research
11/25/2019

Discriminative training of conditional random fields with probably submodular constraints

Problems of segmentation, denoising, registration and 3D reconstruction ...
research
02/14/2012

Approximation by Quantization

Inference in graphical models consists of repeatedly multiplying and sum...

Please sign up or login with your details

Forgot password? Click here to reset