Model Stitching and Visualization How GAN Generators can Invert Networks in Real-Time

02/04/2023
by   Rudolf Herdt, et al.
0

Critical applications, such as in the medical field, require the rapid provision of additional information to interpret decisions made by deep learning methods. In this work, we propose a fast and accurate method to visualize activations of classification and semantic segmentation networks by stitching them with a GAN generator utilizing convolutions. We test our approach on images of animals from the AFHQ wild dataset and real-world digital pathology scans of stained tissue samples. Our method provides comparable results to established gradient descent methods on these datasets while running about two orders of magnitude faster.

READ FULL TEXT

page 2

page 4

page 5

page 8

page 10

page 11

page 12

research
11/30/2018

Evaluating Bayesian Deep Learning Methods for Semantic Segmentation

Deep learning has been revolutionary for computer vision and semantic se...
research
08/14/2018

ScarGAN: Chained Generative Adversarial Networks to Simulate Pathological Tissue on Cardiovascular MR Scans

Medical images with specific pathologies are scarce, but a large amount ...
research
01/31/2021

MultiRocket: Effective summary statistics for convolutional outputs in time series classification

Rocket and MiniRocket, while two of the fastest methods for time series ...
research
07/17/2020

Learn distributed GAN with Temporary Discriminators

In this work, we propose a method for training distributed GAN with sequ...
research
03/04/2020

A Learning Strategy for Contrast-agnostic MRI Segmentation

We present a deep learning strategy that enables, for the first time, co...
research
12/20/2021

Evaluation and Comparison of Deep Learning Methods for Pavement Crack Identification with Visual Images

Compared with contact detection techniques, pavement crack identificatio...
research
03/09/2021

GAN Vocoder: Multi-Resolution Discriminator Is All You Need

Several of the latest GAN-based vocoders show remarkable achievements, o...

Please sign up or login with your details

Forgot password? Click here to reset