Towards Interpretable Deep Networks for Monocular Depth Estimation

08/11/2021
by   Zunzhi You, et al.
8

Deep networks for Monocular Depth Estimation (MDE) have achieved promising performance recently and it is of great importance to further understand the interpretability of these networks. Existing methods attempt to provide posthoc explanations by investigating visual cues, which may not explore the internal representations learned by deep networks. In this paper, we find that some hidden units of the network are selective to certain ranges of depth, and thus such behavior can be served as a way to interpret the internal representations. Based on our observations, we quantify the interpretability of a deep MDE network by the depth selectivity of its hidden units. Moreover, we then propose a method to train interpretable MDE deep networks without changing their original architectures, by assigning a depth range for each unit to select. Experimental results demonstrate that our method is able to enhance the interpretability of deep MDE networks by largely improving the depth selectivity of their units, while not harming or even improving the depth estimation accuracy. We further provide a comprehensive analysis to show the reliability of selective units, the applicability of our method on different layers, models, and datasets, and a demonstration on analysis of model error. Source code and models are available at https://github.com/youzunzhi/InterpretableMDE .

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 8

research
08/22/2018

Rethinking Monocular Depth Estimation with Adversarial Training

Monocular depth estimation is an extensively studied computer vision pro...
research
11/22/2020

Towards Class-Specific Unit

Class selectivity is an attribute of a unit in deep neural networks, whi...
research
08/03/2022

Neural Contourlet Network for Monocular 360 Depth Estimation

For a monocular 360 image, depth estimation is a challenging because the...
research
10/06/2020

Adversarial Patch Attacks on Monocular Depth Estimation Networks

Thanks to the excellent learning capability of deep convolutional neural...
research
03/20/2020

What is the optimal depth for deep-unfolding architectures at deployment?

Recently, many iterative algorithms proposed for various applications su...
research
10/14/2021

Non-deep Networks

Depth is the hallmark of deep neural networks. But more depth means more...
research
03/08/2023

Aberration-Aware Depth-from-Focus

Computer vision methods for depth estimation usually use simple camera m...

Please sign up or login with your details

Forgot password? Click here to reset