research
∙
04/11/2023
r-softmax: Generalized Softmax with Controllable Sparsity Rate
Nowadays artificial neural network models achieve remarkable results in ...
share
research
∙
02/10/2023
Step by Step Loss Goes Very Far: Multi-Step Quantization for Adversarial Text Attacks
We propose a novel gradient-based attack against transformer-based langu...
research
∙
02/08/2023
Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models
Recent transformer language models achieve outstanding results in many n...
research
∙
06/15/2021
Direction is what you need: Improving Word Embedding Compression in Large Language Models
The adoption of Transformer-based models in natural language processing ...
research
∙
06/09/2021
Zero Time Waste: Recycling Predictions in Early Exit Neural Networks
The problem of reducing processing time of large deep learning models is...
research
∙
04/17/2020