Depth Super-Resolution from Explicit and Implicit High-Frequency Features

03/16/2023
by   Xin Qiao, et al.
0

We propose a novel multi-stage depth super-resolution network, which progressively reconstructs high-resolution depth maps from explicit and implicit high-frequency features. The former are extracted by an efficient transformer processing both local and global contexts, while the latter are obtained by projecting color images into the frequency domain. Both are combined together with depth features by means of a fusion strategy within a multi-stage and multi-scale framework. Experiments on the main benchmarks, such as NYUv2, Middlebury, DIML and RGBDD, show that our approach outperforms existing methods by a large margin ( 20 contemporary work DADA, with 16x upsampling), establishing a new state-of-the-art in the guided depth super-resolution task.

READ FULL TEXT

page 1

page 3

page 7

research
06/01/2023

Symmetric Uncertainty-Aware Feature Transmission for Depth Super-Resolution

Color-guided depth super-resolution (DSR) is an encouraging paradigm tha...
research
08/27/2018

Deeply Supervised Depth Map Super-Resolution as Novel View Synthesis

Deep convolutional neural network (DCNN) has been successfully applied t...
research
07/19/2021

Joint Implicit Image Function for Guided Depth Super-Resolution

Guided depth super-resolution is a practical task where a low-resolution...
research
06/02/2020

Channel Attention based Iterative Residual Learning for Depth Map Super-Resolution

Despite the remarkable progresses made in deep-learning based depth map ...
research
12/15/2020

Geometry Enhancements from Visual Content: Going Beyond Ground Truth

This work presents a new cyclic architecture that extracts high-frequenc...
research
10/17/2020

Light Stage Super-Resolution: Continuous High-Frequency Relighting

The light stage has been widely used in computer graphics for the past t...
research
03/15/2023

Spherical Space Feature Decomposition for Guided Depth Map Super-Resolution

Guided depth map super-resolution (GDSR), as a hot topic in multi-modal ...

Please sign up or login with your details

Forgot password? Click here to reset