Holistic Deep Learning

10/29/2021
by   Dimitris Bertsimas, et al.
56

There is much interest in deep learning to solve challenges that arise in applying neural network models in real-world environments. In particular, three areas have received considerable attention: adversarial robustness, parameter sparsity, and output stability. Despite numerous attempts on solving these problems independently, there is very little work addressing the challenges simultaneously. In this paper, we address this problem of constructing holistic deep learning models by proposing a novel formulation that solves these issues in combination. Real-world experiments on both tabular and MNIST dataset show that our formulation is able to simultaneously improve the accuracy, robustness, stability, and sparsity over traditional deep learning models among many others.

READ FULL TEXT
research
02/15/2022

Holistic Adversarial Robustness of Deep Learning Models

Adversarial robustness studies the worst-case performance of a machine l...
research
04/01/2019

Robustness of 3D Deep Learning in an Adversarial Setting

Understanding the spatial arrangement and nature of real-world objects i...
research
10/02/2022

Ensembling improves stability and power of feature selection for deep learning models

With the growing adoption of deep learning models in different real-worl...
research
11/22/2018

Feature Selection for Survival Analysis with Competing Risks using Deep Learning

Deep learning models for survival analysis have gained significant atten...
research
06/04/2020

Characterizing the Weight Space for Different Learning Models

Deep Learning has become one of the primary research areas in developing...
research
05/12/2023

Model-based Programming: Redefining the Atomic Unit of Programming for the Deep Learning Era

This paper introduces and explores a new programming paradigm, Model-bas...

Please sign up or login with your details

Forgot password? Click here to reset