Geometric robustness of deep networks: analysis and improvement

11/24/2017
by   Can Kanbak, et al.
0

Deep convolutional neural networks have been shown to be vulnerable to arbitrary geometric transformations. However, there is no systematic method to measure the invariance properties of deep networks to such transformations. We propose ManiFool as a simple yet scalable algorithm to measure the invariance of deep networks. In particular, our algorithm measures the robustness of deep networks to geometric transformations in a worst-case regime as they can be problematic for sensitive applications. Our extensive experimental results show that ManiFool can be used to measure the invariance of fairly complex networks on high dimensional datasets and these values can be used for analyzing the reasons for it. Furthermore, we build on Manifool to propose a new adversarial training scheme and we show its effectiveness on improving the invariance properties of deep neural networks.

READ FULL TEXT

page 6

page 7

research
07/23/2015

Manitest: Are classifiers really invariant?

Invariance to geometric transformations is a highly desirable property o...
research
11/25/2021

Quantised Transforming Auto-Encoders: Achieving Equivariance to Arbitrary Transformations in Deep Networks

In this work we investigate how to achieve equivariance to input transfo...
research
12/13/2017

Mathematics of Deep Learning

Recently there has been a dramatic increase in the performance of recogn...
research
07/27/2018

Diverse feature visualizations reveal invariances in early layers of deep neural networks

Visualizing features in deep neural networks (DNNs) can help understandi...
research
12/25/2019

SketchTransfer: A Challenging New Task for Exploring Detail-Invariance and the Abstractions Learned by Deep Networks

Deep networks have achieved excellent results in perceptual tasks, yet t...
research
06/18/2021

Training or Architecture? How to Incorporate Invariance in Neural Networks

Many applications require the robustness, or ideally the invariance, of ...
research
01/29/2023

Towards Verifying the Geometric Robustness of Large-scale Neural Networks

Deep neural networks (DNNs) are known to be vulnerable to adversarial ge...

Please sign up or login with your details

Forgot password? Click here to reset