Model Stitching and Visualization How GAN Generators can Invert Networks in Real-Time

02/04/2023
by   Rudolf Herdt, et al.
0

Critical applications, such as in the medical field, require the rapid provision of additional information to interpret decisions made by deep learning methods. In this work, we propose a fast and accurate method to visualize activations of classification and semantic segmentation networks by stitching them with a GAN generator utilizing convolutions. We test our approach on images of animals from the AFHQ wild dataset and real-world digital pathology scans of stained tissue samples. Our method provides comparable results to established gradient descent methods on these datasets while running about two orders of magnitude faster.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset