b'Ivan Vuli\xc4\x87'

research

∙ 05/26/2023

Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging

Massively multilingual language models have displayed strong performance...

0 Fabian David Schmidt, et al. ∙

research

∙ 05/23/2023

CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models

While many languages possess processes of joining two or more words to c...

0 Benjamin Minixhofer, et al. ∙

research

∙ 04/18/2023

Romanization-based Large-scale Adaptation of Multilingual Language Models

Large multilingual pretrained language models (mPLMs) have become the de...

0 Sukannya Purkayastha, et al. ∙

research

∙ 04/18/2023

Transfer to a Low-Resource Language via Close Relatives: The Case Study on Faroese

Multilingual language models have pushed state-of-the-art in cross-lingu...

0 Vésteinn Snæbjarnarson, et al. ∙

research

∙ 02/22/2023

Modular Deep Learning

Transfer learning has recently become the dominant paradigm of machine l...

0 Jonas Pfeiffer, et al. ∙

research

∙ 01/28/2023

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning

Large pretrained language models have been widely used in downstream NLP...

0 Han Zhou, et al. ∙

research

∙ 01/13/2023

Improving Generalization of Adapter-Based Cross-lingual Transfer with Scheduled Unfreezing

Standard fine-tuning of language models typically performs well on in-di...

0 Chen Cecilia Liu, et al. ∙

research

∙ 12/20/2022

MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue

Task-oriented dialogue (TOD) systems have been applied in a range of dom...

0 Nikita Moghe, et al. ∙

research

∙ 10/12/2022

Can Pretrained Language Models (Yet) Reason Deductively?

Acquiring factual knowledge with Pretrained Language Models (PLMs) has a...

0 Zhangdie Yuan, et al. ∙

research

∙ 06/20/2022

Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold

The prototypical NLP experiment trains a standard architecture on labele...

0 Sebastian Ruder, et al. ∙

research

∙ 05/20/2022

Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog

Research on (multi-domain) task-oriented dialog (TOD) has predominantly ...

0 Chia-Chien Hung, et al. ∙

research

∙ 04/28/2022

EVI: Multilingual Spoken Dialogue Tasks and Dataset for Knowledge-Based Enrolment, Verification, and Identification

Knowledge-based authentication is crucial for task-oriented spoken dialo...

0 Georgios P. Spithourakis, et al. ∙

research

∙ 04/27/2022

NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue

We present NLU++, a novel dataset for natural language understanding (NL...

0 Iñigo Casanueva, et al. ∙

research

∙ 04/05/2022

Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval

State-of-the-art neural (re)rankers are notoriously data hungry which - ...

0 Robert Litschko, et al. ∙

research

∙ 04/05/2022

Improved and Efficient Conversational Slot Labeling through Question Answering

Transformer-based pretrained language models (PLMs) offer unmatched perf...

0 Gabor Fuisz, et al. ∙

research

∙ 02/15/2022

Delving Deeper into Cross-lingual Visual Question Answering

Visual question answering (VQA) is one of the crucial vision-and-languag...

1 Chen Liu, et al. ∙

research

∙ 01/31/2022

Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation

Multilingual task-oriented dialogue (ToD) facilitates access to services...

0 Olga Majewska, et al. ∙

research

∙ 12/21/2021

On Cross-Lingual Retrieval with Multilingual Text Encoders

In this work we present a systematic empirical study focused on the suit...

0 Robert Litschko, et al. ∙

research

∙ 10/14/2021

Composable Sparse Fine-Tuning for Cross-Lingual Transfer

Fine-tuning all parameters of a pre-trained model has become the mainstr...

7 Alan Ansell, et al. ∙

research

∙ 09/21/2021

ConvFiT: Conversational Fine-Tuning of Pretrained Language Models

Transformer-based language models (LMs) pretrained on large text collect...

5 Ivan Vulić, et al. ∙

research

∙ 09/19/2021

MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models

Recent work indicated that pretrained language models (PLMs) such as BER...

0 Qianchu Liu, et al. ∙

research

∙ 09/13/2021

xGQA: Cross-Lingual Visual Question Answering

Recent advances in multimodal vision and language modeling have predomin...

17 Jonas Pfeiffer, et al. ∙

research

∙ 08/06/2021

Towards Zero-shot Language Modeling

Can we construct a neural model that is inductively biased towards learn...

0 Edoardo Maria Ponti, et al. ∙

research

∙ 07/23/2021

Modelling Latent Translations for Cross-Lingual Transfer

While achieving state-of-the-art results in multiple tasks and languages...

7 Edoardo Maria Ponti, et al. ∙

research

∙ 06/07/2021

RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Models

Text representation models are prone to exhibit a range of societal bias...

0 Soumya Barikeri, et al. ∙

research

∙ 05/30/2021

Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking

Injecting external domain-specific knowledge (e.g., UMLS) into pretraine...

0 Fangyu Liu, et al. ∙

research

∙ 04/17/2021

AM2iCo: Evaluating Word Meaning in Context across Low-ResourceLanguages with Adversarial Examples

Capturing word meaning in context and distinguishing between corresponde...

0 Qianchu Liu, et al. ∙

research

∙ 04/17/2021

Crossing the Conversational Chasm: A Primer on Multilingual Task-Oriented Dialogue Systems

Despite the fact that natural language conversations with machines repre...

0 Evgeniia Razumovskaia, et al. ∙

research

∙ 04/17/2021

Multilingual and Cross-Lingual Intent Detection from Spoken Data

We present a systematic study on multilingual and cross-lingual intent d...

13 Daniela Gerz, et al. ∙

research

∙ 04/16/2021

Fast, Effective and Self-Supervised: Transforming Masked LanguageModels into Universal Lexical and Sentence Encoders

Pretrained Masked Language Models (MLMs) have revolutionised NLP in rece...

1 Fangyu Liu, et al. ∙

research

∙ 03/22/2021

Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrieval

Current state-of-the-art approaches to cross-modal retrieval process tex...

8 Gregor Geigle, et al. ∙

research

∙ 01/21/2021

Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval

Pretrained multilingual text encoders based on neural Transformer archit...

0 Robert Litschko, et al. ∙

research

∙ 12/31/2020

How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models

In this work we provide a systematic empirical comparison of pretrained ...

12 Phillip Rust, et al. ∙

research

∙ 12/31/2020

UNKs Everywhere: Adapting Multilingual Language Models to New Scripts

Massively multilingual language models such as multilingual BERT (mBERT)...

4 Jonas Pfeiffer, et al. ∙

research

∙ 12/31/2020

Verb Knowledge Injection for Multilingual Event Processing

In parallel to their overwhelming success across NLP tasks, language abi...

0 Olga Majewska, et al. ∙

research

∙ 12/11/2020

Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer

Adapter modules, additional trainable parameters that enable efficient f...

0 Marko Vidoni, et al. ∙

research

∙ 11/02/2020

Emergent Communication Pretraining for Few-Shot Machine Translation

While state-of-the-art models that rely upon massively multilingual pret...

0 Yaoyiran Li, et al. ∙

research

∙ 10/22/2020

ConVEx: Data-Efficient and Few-Shot Slot Labeling

We propose ConVEx (Conversational Value Extractor), an efficient pretrai...

0 Matthew Henderson, et al. ∙

research

∙ 10/12/2020

Probing Pretrained Language Models for Lexical Semantics

The success of large pretrained language models (LMs) such as BERT and R...

0 Ivan Vulić, et al. ∙

research

∙ 08/15/2020

Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation

Traditional NLP has long held (supervised) syntactic parsing necessary f...

0 Goran Glavaš, et al. ∙

research

∙ 07/15/2020

AdapterHub: A Framework for Adapting Transformers

The current modus operandi in NLP involves downloading and fine-tuning p...

0 Jonas Pfeiffer, et al. ∙

research

∙ 05/18/2020

Span-ConveRT: Few-shot Span Extraction for Dialog with Pretrained Conversational Representations

We introduce Span-ConveRT, a light-weight model for dialog slot-filling ...

0 Sam Coope, et al. ∙

research

∙ 05/11/2020

Multidirectional Associative Optimization of Function-Specific Word Representations

We present a neural framework for learning associations between interrel...

0 Daniela Gerz, et al. ∙

research

∙ 05/01/2020

From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers

Massively multilingual transformers pretrained with language modeling ob...

0 Anne Lauscher, et al. ∙

research

∙ 05/01/2020

XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning

In order to simulate human language capacity, natural language processin...

0 Edoardo Maria Ponti, et al. ∙

research

∙ 04/30/2020

MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer

The main goal behind state-of-the-art pretrained multilingual models suc...

0 Jonas Pfeiffer, et al. ∙

research

∙ 04/16/2020

Towards Instance-Level Parser Selection for Cross-Lingual Transfer of Dependency Parsers

Current methods of cross-lingual parser transfer focus on predicting the...

0 Robert Litschko, et al. ∙

research

∙ 04/08/2020

Are All Good Word Vector Spaces Isomorphic?

Existing algorithms for aligning cross-lingual word vector spaces assume...

0 Ivan Vulić, et al. ∙

research

∙ 03/10/2020

Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity

We introduce Multi-SimLex, a large-scale lexical resource and evaluation...

0 Ivan Vulić, et al. ∙

research

∙ 03/10/2020

Efficient Intent Detection with Dual Sentence Encoders

Building conversational systems in new domains and with added functional...

0 Iñigo Casanueva, et al. ∙

Ivan Vulić

Featured Co-authors