Deep Neural Networks

10/25/2017
by   Randall Balestriero, et al.
0

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now commonly tackled via DNNs. Some fundamental problems remain: (1) the lack of a mathematical framework providing an explicit and interpretable input-output formula for any topology, (2) quantification of DNNs stability regarding adversarial examples (i.e. modified inputs fooling DNN predictions whilst undetectable to humans), (3) absence of generalization guarantees and controllable behaviors for ambiguous patterns, (4) leverage unlabeled data to apply DNNs to domains where expert labeling is scarce as in the medical field. Answering those points would provide theoretical perspectives for further developments based on a common ground. Furthermore, DNNs are now deployed in tremendous societal applications, pushing the need to fill this theoretical gap to ensure control, reliability, and interpretability.

READ FULL TEXT

page 6

page 33

page 34

page 35

research
05/28/2023

Amplification trojan network: Attack deep neural networks by amplifying their inherent weakness

Recent works found that deep neural networks (DNNs) can be fooled by adv...
research
04/20/2020

GraN: An Efficient Gradient-Norm Based Detector for Adversarial and Misclassified Examples

Deep neural networks (DNNs) are vulnerable to adversarial examples and o...
research
12/02/2022

SimpleMind adds thinking to deep neural networks

Deep neural networks (DNNs) detect patterns in data and have shown versa...
research
08/21/2020

A Survey on Assessing the Generalization Envelope of Deep Neural Networks at Inference Time for Image Classification

Deep Neural Networks (DNNs) achieve state-of-the-art performance on nume...
research
01/22/2021

i-Algebra: Towards Interactive Interpretability of Deep Neural Networks

Providing explanations for deep neural networks (DNNs) is essential for ...
research
01/31/2023

Interpreting Robustness Proofs of Deep Neural Networks

In recent years numerous methods have been developed to formally verify ...
research
02/18/2023

Structural Neural Additive Models: Enhanced Interpretable Machine Learning

Deep neural networks (DNNs) have shown exceptional performances in a wid...

Please sign up or login with your details

Forgot password? Click here to reset