Adversarial training for predictive tasks: theoretical analysis and limitations in the deterministic case

11/02/2020
by   Thibault Lesieur, et al.
0

To train a deep neural network to mimic the outcomes of processing sequences, a version of Conditional Generalized Adversarial Network (CGAN) can be used. It has been observed by others that CGAN can help to improve the results even for deterministic sequences, where only one output is associated with the processing of a given input. Surprisingly, our CGAN-based tests on deterministic geophysical processing sequences did not produce a real improvement compared to the use of an L_p loss; we here propose a first theoretical explanation why. Our analysis goes from the non-deterministic case to the deterministic one. It led us to develop an adversarial way to train a content loss that gave better results on our data.

READ FULL TEXT

page 2

page 7

research
07/08/2023

Sup-Norm Convergence of Deep Neural Network Estimator for Nonparametric Regression by Adversarial Training

We show the sup-norm convergence of deep neural network estimators with ...
research
07/01/2020

Estimation with Uncertainty via Conditional Generative Adversarial Networks

Conventional predictive Artificial Neural Networks (ANNs) commonly emplo...
research
05/26/2019

Non-Determinism in Neural Networks for Adversarial Robustness

Recent breakthroughs in the field of deep learning have led to advanceme...
research
12/31/2020

3D Human motion anticipation and classification

Human motion prediction and understanding is a challenging problem. Due ...
research
05/02/2018

Markov Chain Neural Networks

In this work we present a modified neural network model which is capable...
research
06/09/2015

Learning to Linearize Under Uncertainty

Training deep feature hierarchies to solve supervised learning tasks has...
research
09/05/2022

A negative dependence framework to assess different forms of scrambling

We use the framework of dependence to assess the benefits of scrambling ...

Please sign up or login with your details

Forgot password? Click here to reset