Learning a Loopy Model For Semantic Segmentation Exactly

Learning structured models using maximum margin techniques has become an indispensable tool for com- puter vision researchers, as many computer vision applications can be cast naturally as an image labeling problem. Pixel-based or superpixel-based conditional random fields are particularly popular examples. Typ- ically, neighborhood graphs, which contain a large number of cycles, are used. As exact inference in loopy graphs is NP-hard in general, learning these models without approximations is usually deemed infeasible. In this work we show that, despite the theoretical hardness, it is possible to learn loopy models exactly in practical applications. To this end, we analyze the use of multiple approximate inference techniques together with cutting plane training of structural SVMs. We show that our proposed method yields exact solutions with an optimality guarantees in a computer vision application, for little additional computational cost. We also propose a dynamic caching scheme to accelerate training further, yielding runtimes that are comparable with approximate methods. We hope that this insight can lead to a reconsideration of the tractability of loopy models in computer vision.

READ FULL TEXT
research
06/18/2014

Exact Decoding on Latent Variable Conditional Models is NP-Hard

Latent variable conditional models, including the latent conditional ran...
research
01/05/2020

Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysis

The success of deep learning in visual recognition tasks has driven adva...
research
09/19/2009

Extension of Path Probability Method to Approximate Inference over Time

There has been a tremendous growth in publicly available digital video f...
research
11/17/2010

An Introduction to Conditional Random Fields

Often we wish to predict a large number of variables that depend on each...
research
06/06/2022

EVC-Net: Multi-scale V-Net with Conditional Random Fields for Brain Extraction

Brain extraction is one of the first steps of pre-processing 3D brain MR...
research
03/02/2018

Independence number and the number of maximum independent sets in pseudofractal scale-free web and Sierpiński gasket

As a fundamental subject of theoretical computer science, the maximum in...
research
07/22/2017

Coarse-to-Fine Lifted MAP Inference in Computer Vision

There is a vast body of theoretical research on lifted inference in prob...

Please sign up or login with your details

Forgot password? Click here to reset