A Diffractive Neural Network with Weight-Noise-Injection Training

06/08/2020
by   Jiashuo Shi, et al.
0

We propose a diffractive neural network with strong robustness based on Weight Noise Injection training, which achieves accurate and fast optical-based classification while diffraction layers have a certain amount of surface shape error. To the best of our knowledge, it is the first time that using injection weight noise during training to reduce the impact of external interference on deep learning inference results. In the proposed method, the diffractive neural network learns the mapping between the input image and the label in Weight Noise Injection mode, making the network's weight insensitive to modest changes, which improve the network's noise resistance at a lower cost. By comparing the accuracy of the network under different noise, it is verified that the proposed network (SRNN) still maintains a higher accuracy under serious noise.

READ FULL TEXT

page 3

page 6

research
06/05/2023

Sensitivity-Aware Finetuning for Accuracy Recovery on Deep Learning Hardware

Existing methods to recover model accuracy on analog-digital hardware in...
research
09/05/2020

S-SGD: Symmetrical Stochastic Gradient Descent with Weight Noise Injection for Reaching Flat Minima

The stochastic gradient descent (SGD) method is most widely used for dee...
research
06/30/2023

Impact of Noise on Calibration and Generalisation of Neural Networks

Noise injection and data augmentation strategies have been effective for...
research
10/24/2022

Noise Injection as a Probe of Deep Learning Dynamics

We propose a new method to probe the learning mechanism of Deep Neural N...
research
06/30/2020

Neural Network Virtual Sensors for Fuel Injection Quantities with Provable Performance Specifications

Recent work has shown that it is possible to learn neural networks with ...
research
04/06/2021

Enabling Inference Privacy with Adaptive Noise Injection

User-facing software services are becoming increasingly reliant on remot...
research
07/12/2023

Data Augmentation in Training CNNs: Injecting Noise to Images

Noise injection is a fundamental tool for data augmentation, and yet the...

Please sign up or login with your details

Forgot password? Click here to reset