A Divide-and-Conquer Approach towards Understanding Deep Networks

07/14/2019
by   Weilin Fu, et al.
10

Deep neural networks have achieved tremendous success in various fields including medical image segmentation. However, they have long been criticized for being a black-box, in that interpretation, understanding and correcting architectures is difficult as there is no general theory for deep neural network design. Previously, precision learning was proposed to fuse deep architectures and traditional approaches. Deep networks constructed in this way benefit from the original known operator, have fewer parameters, and improved interpretability. However, they do not yield state-of-the-art performance in all applications. In this paper, we propose to analyze deep networks using known operators, by adopting a divide-and-conquer strategy to replace network components, whilst retaining its performance. The task of retinal vessel segmentation is investigated for this purpose. We start with a high-performance U-Net and show by step-by-step conversion that we are able to divide the network into modules of known operators. The results indicate that a combination of a trainable guided filter and a trainable version of the Frangi filter yields a performance at the level of U-Net (AUC 0.974 vs. 0.972) with a tremendous reduction in parameters (111,536 vs. 9,575). In addition, the trained layers can be mapped back into their original algorithmic interpretation and analyzed using standard tools of signal processing.

READ FULL TEXT

page 3

page 7

research
10/15/2022

MKIS-Net: A Light-Weight Multi-Kernel Network for Medical Image Segmentation

Image segmentation is an important task in medical imaging. It constitut...
research
06/10/2020

Searching Learning Strategy with Reinforcement Learning for 3D Medical Image Segmentation

Deep neural network (DNN) based approaches have been widely investigated...
research
03/30/2021

Assessing the Role of Random Forests in Medical Image Segmentation

Neural networks represent a field of research that can quickly achieve v...
research
09/30/2022

Verifiable and Energy Efficient Medical Image Analysis with Quantised Self-attentive Deep Neural Networks

Convolutional Neural Networks have played a significant role in various ...
research
05/29/2020

WaveSNet: Wavelet Integrated Deep Networks for Image Segmentation

In deep networks, the lost data details significantly degrade the perfor...
research
06/06/2018

Deep Algorithms: designs for networks

A new design methodology for neural networks that is guided by tradition...
research
03/05/2022

IDmUNet: A new image decomposition induced network for sparse feature segmentation

UNet and its variants are among the most popular methods for medical ima...

Please sign up or login with your details

Forgot password? Click here to reset