SSGP: Sparse Spatial Guided Propagation for Robust and Generic Interpolation

08/21/2020
by   René Schuster, et al.
0

Interpolation of sparse pixel information towards a dense target resolution finds its application across multiple disciplines in computer vision. State-of-the-art interpolation of motion fields applies model-based interpolation that makes use of edge information extracted from the target image. For depth completion, data-driven learning approaches are widespread. Our work is inspired by latest trends in depth completion that tackle the problem of dense guidance for sparse information. We extend these ideas and create a generic cross-domain architecture that can be applied for a multitude of interpolation problems like optical flow, scene flow, or depth completion. In our experiments, we show that our proposed concept of Sparse Spatial Guided Propagation (SSGP) achieves improvements to robustness, accuracy, or speed compared to specialized algorithms.

READ FULL TEXT

page 1

page 8

research
11/29/2016

InterpoNet, A brain inspired neural network for optical flow dense interpolation

Sparse-to-dense interpolation for optical flow is a fundamental phase in...
research
10/27/2017

SceneFlowFields: Dense Interpolation of Sparse Scene Flow Correspondences

While most scene flow methods use either variational optimization or a s...
research
02/26/2019

SceneFlowFields++: Multi-frame Matching, Visibility Prediction, and Robust Interpolation for Scene Flow Estimation

State-of-the-art scene flow algorithms pursue the conflicting targets of...
research
09/23/2018

Unsupervised Learning of Dense Optical Flow and Depth from Sparse Event Data

In this work we present unsupervised learning of depth and motion from s...
research
10/21/2020

MonoComb: A Sparse-to-Dense Combination Approach for Monocular Scene Flow

Contrary to the ongoing trend in automotive applications towards usage o...
research
03/15/2017

Learning Rank Reduced Interpolation with Principal Component Analysis

In computer vision most iterative optimization algorithms, both sparse a...
research
11/13/2019

CSPN++: Learning Context and Resource Aware Convolutional Spatial Propagation Networks for Depth Completion

Depth Completion deals with the problem of converting a sparse depth map...

Please sign up or login with your details

Forgot password? Click here to reset