Deep Depth Super-Resolution : Learning Depth Super-Resolution using Deep Convolutional Neural Network

07/07/2016
by   Xibin Song, et al.
0

Depth image super-resolution is an extremely challenging task due to the information loss in sub-sampling. Deep convolutional neural network have been widely applied to color image super-resolution. Quite surprisingly, this success has not been matched to depth super-resolution. This is mainly due to the inherent difference between color and depth images. In this paper, we bridge up the gap and extend the success of deep convolutional neural network to depth super-resolution. The proposed deep depth super-resolution method learns the mapping from a low-resolution depth image to a high resolution one in an end-to-end style. Furthermore, to better regularize the learned depth map, we propose to exploit the depth field statistics and the local correlation between depth image and color image. These priors are integrated in an energy minimization formulation, where the deep neural network learns the unary term, the depth field statistics works as global model constraint and the color-depth correlation is utilized to enforce the local structure in depth images. Extensive experiments on various depth super-resolution benchmark datasets show that our method outperforms the state-of-the-art depth image super-resolution methods with a margin.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

page 8

page 10

page 11

research
01/22/2022

A Review of Deep Learning Based Image Super-resolution Techniques

Image super-resolution technology is the process of obtaining high-resol...
research
12/04/2017

Learning Reduced-Resolution and Super-Resolution Networks in Synch

Recent studies have shown that deep convolutional neural networks achiev...
research
08/27/2018

Deeply Supervised Depth Map Super-Resolution as Novel View Synthesis

Deep convolutional neural network (DCNN) has been successfully applied t...
research
01/03/2018

Joint convolutional neural pyramid for depth map super-resolution

High-resolution depth map can be inferred from a low-resolution one with...
research
12/21/2021

Can We Use Neural Regularization to Solve Depth Super-Resolution?

Depth maps captured with commodity sensors often require super-resolutio...
research
09/18/2018

Image Super-Resolution via Deterministic-Stochastic Synthesis and Local Statistical Rectification

Single image superresolution has been a popular research topic in the la...
research
04/10/2020

Simulation-based Lidar Super-resolution for Ground Vehicles

We propose a methodology for lidar super-resolution with ground vehicles...

Please sign up or login with your details

Forgot password? Click here to reset