SSSC-AM: A Unified Framework for Video Co-Segmentation by Structured Sparse Subspace Clustering with Appearance and Motion Features

03/14/2016
by   Junlin Yao, et al.
0

Video co-segmentation refers to the task of jointly segmenting common objects appearing in a given group of videos. In practice, high-dimensional data such as videos can be conceptually thought as being drawn from a union of subspaces corresponding to categories rather than from a smooth manifold. Therefore, segmenting data into respective subspaces --- subspace clustering --- finds widespread applications in computer vision, including co-segmentation. State-of-the-art methods via subspace clustering seek to solve the problem in two steps: First, an affinity matrix is built from data, with appearance features or motion patterns. Second, the data are segmented by applying spectral clustering to the affinity matrix. However, this process is insufficient to obtain an optimal solution since it does not take into account the interdependence of the affinity matrix with the segmentation. In this work, we present a novel unified video co-segmentation framework inspired by the recent Structured Sparse Subspace Clustering (S^3C) based on the self-expressiveness model. Our method yields more consistent segmentation results. In order to improve the detectability of motion features with missing trajectories due to occlusion or tracked points moving out of frames, we add an extra-dimensional signature to the motion trajectories. Moreover, we reformulate the S^3C algorithm by adding the affine subspace constraint in order to make it more suitable to segment rigid motions lying in affine subspaces of dimension at most 3. Our experiments on MOViCS dataset show that our framework achieves the highest overall performance among baseline algorithms and demonstrate its robustness to heavy noise.

READ FULL TEXT

page 12

page 13

page 15

page 16

research
10/17/2016

Structured Sparse Subspace Clustering: A Joint Affinity Learning and Subspace Clustering Framework

Subspace clustering refers to the problem of segmenting data drawn from ...
research
01/24/2017

Motion Segmentation via Global and Local Sparse Subspace Optimization

In this paper, we propose a new framework for segmenting feature-based m...
research
04/10/2013

A New Approach To Two-View Motion Segmentation Using Global Dimension Minimization

We present a new approach to rigid-body motion segmentation from two vie...
research
05/21/2018

Constrained Sparse Subspace Clustering with Side-Information

Subspace clustering refers to the problem of segmenting high dimensional...
research
04/27/2014

Robust and Efficient Subspace Segmentation via Least Squares Regression

This paper studies the subspace segmentation problem which aims to segme...
research
09/09/2009

Kernel Spectral Curvature Clustering (KSCC)

Multi-manifold modeling is increasingly used in segmentation and data re...
research
07/13/2019

Motion Segmentation Using Locally Affine Atom Voting

We present a novel method for motion segmentation called LAAV (Locally A...

Please sign up or login with your details

Forgot password? Click here to reset