A Deep Primal-Dual Network for Guided Depth Super-Resolution

07/28/2016
by   Gernot Riegler, et al.
0

In this paper we present a novel method to increase the spatial resolution of depth images. We combine a deep fully convolutional network with a non-local variational method in a deep primal-dual network. The joint network computes a noise-free, high-resolution estimate from a noisy, low-resolution input depth map. Additionally, a high-resolution intensity image is used to guide the reconstruction in the network. By unrolling the optimization steps of a first-order primal-dual algorithm and formulating it as a network, we can train our joint method end-to-end. This not only enables us to learn the weights of the fully convolutional network, but also to optimize all parameters of the variational method and its optimization procedure. The training of such a deep network requires a large dataset for supervision. Therefore, we generate high-quality depth maps and corresponding color images with a physically based renderer. In an exhaustive evaluation we show that our method outperforms the state-of-the-art on multiple benchmarks.

READ FULL TEXT

page 7

page 9

page 10

research
07/27/2016

ATGV-Net: Accurate Depth Super-Resolution

In this work we present a novel approach for single depth map super-reso...
research
06/15/2022

High-Resolution Bathymetric Reconstruction From Sidescan Sonar With Deep Neural Networks

We propose a novel data-driven approach for high-resolution bathymetric ...
research
01/21/2020

Multimodal Deep Unfolding for Guided Image Super-Resolution

The reconstruction of a high resolution image given a low resolution obs...
research
11/20/2020

Robust super-resolution depth imaging via a multi-feature fusion deep network

Three-dimensional imaging plays an important role in imaging application...
research
04/19/2013

A Joint Intensity and Depth Co-Sparse Analysis Model for Depth Map Super-Resolution

High-resolution depth maps can be inferred from low-resolution depth mea...
research
01/26/2018

PDNet: Semantic Segmentation integrated with a Primal-Dual Network for Document binarization

Binarization of digital documents is the task of classifying each pixel ...
research
10/30/2022

FatNet: High Resolution Kernels for Classification Using Fully Convolutional Optical Neural Networks

This paper describes the transformation of a traditional in-silico class...

Please sign up or login with your details

Forgot password? Click here to reset