Eldar Kurtic | DeepAI

DeepAI AI Chat

Featured Co-authors

Dan Alistarh
79 publications
Sara Beery
22 publications
Daniel Campos
19 publications
Elias Frantar
16 publications
Zlatan Ajanovic
12 publications
Alexandra Peşte
9 publications
Denis Kuznedelev
8 publications
Tuan Nguyen
8 publications
Hamza Merzic
7 publications
Eugenia Iofinova
6 publications
Kimia
5 publications

∙ 08/03/2023

Accurate Neural Network Pruning Requires Rethinking Sparse Optimization

Obtaining versions of deep neural networks that are both highly-accurate...

0 Denis Kuznedelev, et al. ∙

∙ 06/09/2023

Error Feedback Can Accurately Compress Preconditioners

Leveraging second-order information at the scale of deep networks is one...

0 Ionuţ-Vlad Modoranu, et al. ∙

∙ 03/25/2023

Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression

Recent vision architectures and self-supervised training methods enable ...

3 Denis Kuznedelev, et al. ∙

∙ 02/09/2023

SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks

We provide a new efficient version of the backpropagation algorithm, spe...

0 Mahdi Nikdan, et al. ∙

∙ 02/07/2023

ZipLM: Hardware-Aware Structured Pruning of Language Models

The breakthrough performance of large language models (LLMs) comes with ...

0 Eldar Kurtic, et al. ∙

∙ 10/14/2022

oViT: An Accurate Second-Order Pruning Framework for Vision Transformers

Models from the Vision Transformer (ViT) family have recently provided b...

0 Denis Kuznedelev, et al. ∙

∙ 10/12/2022

GMP*: Well-Tuned Global Magnitude Pruning Can Outperform Most BERT-Pruning Methods

We revisit the performance of the classic gradual magnitude pruning (GMP...

0 Eldar Kurtic, et al. ∙

∙ 09/08/2022

Vision for Bosnia and Herzegovina in Artificial Intelligence Age: Global Trends, Potential Opportunities, Selected Use-cases and Realistic Goals

Artificial Intelligence (AI) is one of the most promising technologies o...

14 Zlatan Ajanovic, et al. ∙

∙ 03/14/2022

The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models

Pre-trained Transformer-based language models have become a key building...

0 Eldar Kurtic, et al. ∙

∙ 07/07/2021

Efficient Matrix-Free Approximations of Second-Order Information, with Applications to Pruning and Optimization

Efficiently approximating local curvature information of the loss functi...

0 Elias Frantar, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world