Single Image Depth Estimation using Wavelet Decomposition

06/03/2021
by   Michaël Ramamonjisoa, et al.
19

We present a novel method for predicting accurate depths from monocular images with high efficiency. This optimal efficiency is achieved by exploiting wavelet decomposition, which is integrated in a fully differentiable encoder-decoder architecture. We demonstrate that we can reconstruct high-fidelity depth maps by predicting sparse wavelet coefficients. In contrast with previous works, we show that wavelet coefficients can be learned without direct supervision on coefficients. Instead we supervise only the final depth image that is reconstructed through the inverse wavelet transform. We additionally show that wavelet coefficients can be learned in fully self-supervised scenarios, without access to ground-truth depth. Finally, we apply our method to different state-of-the-art monocular depth estimation models, in each case giving similar or better results compared to the original model, while requiring less than half the multiply-adds in the decoder network. Code at https://github.com/nianticlabs/wavelet-monodepth

READ FULL TEXT

page 7

page 14

page 17

page 18

page 19

page 20

page 21

page 22

research
04/08/2019

Learning monocular depth estimation infusing traditional stereo knowledge

Depth estimation from a single image represents a fascinating, yet chall...
research
09/17/2023

Deep Neighbor Layer Aggregation for Lightweight Self-Supervised Monocular Depth Estimation

With the frequent use of self-supervised monocular depth estimation in r...
research
10/04/2019

Robust Semi-Supervised Monocular Depth Estimation with Reprojected Distances

Dense depth estimation from a single image is a key problem in computer ...
research
03/28/2022

LocalBins: Improving Depth Estimation by Learning Local Distributions

We propose a novel architecture for depth estimation from a single image...
research
08/03/2022

Neural Contourlet Network for Monocular 360 Depth Estimation

For a monocular 360 image, depth estimation is a challenging because the...
research
04/05/2022

P3Depth: Monocular Depth Estimation with a Piecewise Planarity Prior

Monocular depth estimation is vital for scene understanding and downstre...
research
03/15/2000

Image Compression with Iterated Function Systems, Finite Automata and Zerotrees: Grand Unification

Fractal image compression, Culik's image compression and zerotree predic...

Please sign up or login with your details

Forgot password? Click here to reset