Ahmet Üstün | DeepAI

AI Chat

Featured Co-authors

Laurent Besacier
68 publications
Sebastian Ruder
68 publications
Phil Blunsom
63 publications
Barbara Plank
55 publications
Mamoru Komachi
36 publications
Antonio Toral
29 publications
Sara Hooker
28 publications
Rob van der Goot
22 publications
Alex Wang
21 publications
Arianna Bisazza
18 publications
Alexandre Berard
18 publications

∙ 09/11/2023

Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

The Mixture of Experts (MoE) is a widely known neural architecture where...

0 Ted Zadouri, et al. ∙

∙ 09/08/2023

When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale

Large volumes of text data have contributed significantly to the develop...

0 Max Marion, et al. ∙

∙ 05/30/2023

Intriguing Properties of Quantization at Scale

Emergent properties have been widely adopted as a term to describe behav...

10 Arash Ahmadian, et al. ∙

∙ 05/24/2022

Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer

Massively multilingual models are promising for transfer learning across...

0 Ahmet Üstün, et al. ∙

∙ 05/23/2022

When does Parameter-Efficient Transfer Learning Work for Machine Translation?

Parameter-efficient fine-tuning methods (PEFTs) offer the promise of ada...

0 Ahmet Üstün, et al. ∙

∙ 10/20/2021

Multilingual Unsupervised Neural Machine Translation with Denoising Adapters

We consider the problem of multilingual unsupervised machine translation...

0 Ahmet Üstün, et al. ∙

∙ 09/24/2021

Unsupervised Translation of German–Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language

This paper describes the methods behind the systems submitted by the Uni...

0 Lukas Edman, et al. ∙

∙ 07/13/2021

On the Difficulty of Translating Free-Order Case-Marking Languages

Identifying factors that make certain languages harder to model than oth...

0 Arianna Bisazza, et al. ∙

∙ 05/15/2021

From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding

The lack of publicly available evaluation data for low-resource language...

0 Rob van der Goot, et al. ∙

∙ 03/01/2021

On the Effectiveness of Dataset Embeddings in Mono-lingual,Multi-lingual and Zero-shot Conditions

Recent complementary strands of research have shown that leveraging info...

0 Rob van der Goot, et al. ∙

∙ 07/24/2020

FiSSA at SemEval-2020 Task 9: Fine-tuned For Feelings

In this paper, we present our approach for sentiment classification on S...

0 Bertelt Braaksma, et al. ∙

∙ 05/29/2020

Massive Choice, Ample Tasks (MaChAmp):A Toolkit for Multi-task Learning in NLP

Transfer learning, particularly approaches that combine multi-task learn...

0 Rob van der Goot, et al. ∙

∙ 04/29/2020

UDapter: Language Adaptation for Truly Universal Dependency Parsing

Recent advances in the field of multilingual dependency parsing have bro...

0 Ahmet Üstün, et al. ∙

∙ 04/24/2017

A Trie-Structured Bayesian Model for Unsupervised Morphological Segmentation

In this paper, we introduce a trie-structured Bayesian model for unsuper...

0 Murathan Kurfalı, et al. ∙

∙ 03/09/2017

Turkish PoS Tagging by Reducing Sparsity with Morpheme Tags in Small Datasets

Sparsity is one of the major problems in natural language processing. Th...

0 Burcu Can, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world