research
∙
07/26/2023
Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems
Creating high-quality annotated data for task-oriented dialog (ToD) is k...
share
research
∙
07/04/2023
Knowledge-Aware Audio-Grounded Generative Slot Filling for Limited Annotated Data
Manually annotating fine-grained slot-value labels for task-oriented dia...
research
∙
06/05/2023
Cross-Lingual Transfer with Target Language-Ready Task Adapters
Adapters have emerged as a modular and parameter-efficient approach to (...
research
∙
06/02/2023
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer
Massively multilingual Transformers (MMTs), such as mBERT and XLM-R, are...
research
∙
05/30/2023
Translation-Enhanced Multilingual Text-to-Image Generation
Research on text-to-image generation (TTI) still predominantly focuses o...
research
∙
05/30/2023
Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation
Many NLP pipelines split text into sentences as one of the crucial prepr...
research
∙
05/26/2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging
Massively multilingual language models have displayed strong performance...
research
∙
05/23/2023
CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models
While many languages possess processes of joining two or more words to c...
research
∙
04/18/2023
Romanization-based Large-scale Adaptation of Multilingual Language Models
Large multilingual pretrained language models (mPLMs) have become the de...
research
∙
04/18/2023
Transfer to a Low-Resource Language via Close Relatives: The Case Study on Faroese
Multilingual language models have pushed state-of-the-art in cross-lingu...
research
∙
02/22/2023
Modular Deep Learning
Transfer learning has recently become the dominant paradigm of machine l...
research
∙
01/28/2023
AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
Large pretrained language models have been widely used in downstream NLP...
research
∙
01/13/2023
Improving Generalization of Adapter-Based Cross-lingual Transfer with Scheduled Unfreezing
Standard fine-tuning of language models typically performs well on in-di...
research
∙
12/20/2022
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue
Task-oriented dialogue (TOD) systems have been applied in a range of dom...
research
∙
10/12/2022
Can Pretrained Language Models (Yet) Reason Deductively?
Acquiring factual knowledge with Pretrained Language Models (PLMs) has a...
research
∙
06/20/2022
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold
The prototypical NLP experiment trains a standard architecture on labele...
research
∙
05/20/2022
Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog
Research on (multi-domain) task-oriented dialog (TOD) has predominantly ...
research
∙
04/28/2022
EVI: Multilingual Spoken Dialogue Tasks and Dataset for Knowledge-Based Enrolment, Verification, and Identification
Knowledge-based authentication is crucial for task-oriented spoken dialo...
research
∙
04/27/2022
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue
We present NLU++, a novel dataset for natural language understanding (NL...
research
∙
04/05/2022
Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval
State-of-the-art neural (re)rankers are notoriously data hungry which - ...
research
∙
04/05/2022
Improved and Efficient Conversational Slot Labeling through Question Answering
Transformer-based pretrained language models (PLMs) offer unmatched perf...
research
∙
02/15/2022
Delving Deeper into Cross-lingual Visual Question Answering
Visual question answering (VQA) is one of the crucial vision-and-languag...
research
∙
01/31/2022
Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation
Multilingual task-oriented dialogue (ToD) facilitates access to services...
research
∙
12/21/2021
On Cross-Lingual Retrieval with Multilingual Text Encoders
In this work we present a systematic empirical study focused on the suit...
research
∙
10/14/2021
Composable Sparse Fine-Tuning for Cross-Lingual Transfer
Fine-tuning all parameters of a pre-trained model has become the mainstr...
research
∙
09/21/2021
ConvFiT: Conversational Fine-Tuning of Pretrained Language Models
Transformer-based language models (LMs) pretrained on large text collect...
research
∙
09/19/2021
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models
Recent work indicated that pretrained language models (PLMs) such as BER...
research
∙
09/13/2021
xGQA: Cross-Lingual Visual Question Answering
Recent advances in multimodal vision and language modeling have predomin...
research
∙
08/06/2021
Towards Zero-shot Language Modeling
Can we construct a neural model that is inductively biased towards learn...
research
∙
07/23/2021
Modelling Latent Translations for Cross-Lingual Transfer
While achieving state-of-the-art results in multiple tasks and languages...
research
∙
06/07/2021
RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Models
Text representation models are prone to exhibit a range of societal bias...
research
∙
05/30/2021
Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking
Injecting external domain-specific knowledge (e.g., UMLS) into pretraine...
research
∙
04/17/2021
AM2iCo: Evaluating Word Meaning in Context across Low-ResourceLanguages with Adversarial Examples
Capturing word meaning in context and distinguishing between corresponde...
research
∙
04/17/2021
Crossing the Conversational Chasm: A Primer on Multilingual Task-Oriented Dialogue Systems
Despite the fact that natural language conversations with machines repre...
research
∙
04/17/2021
Multilingual and Cross-Lingual Intent Detection from Spoken Data
We present a systematic study on multilingual and cross-lingual intent d...
research
∙
04/16/2021
Fast, Effective and Self-Supervised: Transforming Masked LanguageModels into Universal Lexical and Sentence Encoders
Pretrained Masked Language Models (MLMs) have revolutionised NLP in rece...
research
∙
03/22/2021
Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrieval
Current state-of-the-art approaches to cross-modal retrieval process tex...
research
∙
01/21/2021
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval
Pretrained multilingual text encoders based on neural Transformer archit...
research
∙
12/31/2020
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models
In this work we provide a systematic empirical comparison of pretrained ...
research
∙
12/31/2020
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts
Massively multilingual language models such as multilingual BERT (mBERT)...
research
∙
12/31/2020
Verb Knowledge Injection for Multilingual Event Processing
In parallel to their overwhelming success across NLP tasks, language abi...
research
∙
12/11/2020
Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer
Adapter modules, additional trainable parameters that enable efficient f...
research
∙
11/02/2020
Emergent Communication Pretraining for Few-Shot Machine Translation
While state-of-the-art models that rely upon massively multilingual pret...
research
∙
10/22/2020
ConVEx: Data-Efficient and Few-Shot Slot Labeling
We propose ConVEx (Conversational Value Extractor), an efficient pretrai...
research
∙
10/12/2020
Probing Pretrained Language Models for Lexical Semantics
The success of large pretrained language models (LMs) such as BERT and R...
research
∙
08/15/2020
Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation
Traditional NLP has long held (supervised) syntactic parsing necessary f...
research
∙
07/15/2020
AdapterHub: A Framework for Adapting Transformers
The current modus operandi in NLP involves downloading and fine-tuning p...
research
∙
05/18/2020
Span-ConveRT: Few-shot Span Extraction for Dialog with Pretrained Conversational Representations
We introduce Span-ConveRT, a light-weight model for dialog slot-filling ...
research
∙
05/11/2020
Multidirectional Associative Optimization of Function-Specific Word Representations
We present a neural framework for learning associations between interrel...
research
∙
05/01/2020