Pruning Coherent Integrated Photonic Neural Networks Using the Lottery Ticket Hypothesis

12/14/2021
by   Sanmitra Banerjee, et al.
0

Singular-value-decomposition-based coherent integrated photonic neural networks (SC-IPNNs) have a large footprint, suffer from high static power consumption for training and inference, and cannot be pruned using conventional DNN pruning techniques. We leverage the lottery ticket hypothesis to propose the first hardware-aware pruning method for SC-IPNNs that alleviates these challenges by minimizing the number of weight parameters. We prune a multi-layer perceptron-based SC-IPNN and show that up to 89 angles, which correspond to weight parameters in SC-IPNNs, can be pruned with a negligible accuracy loss (smaller than 5 consumption by up to 86

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset