research
∙
08/09/2023
Information-Theoretic Characterization of Vowel Harmony: A Cross-Linguistic Study on Word Lists
We present a cross-linguistic study that aims to quantify vowel harmony ...
share
research
∙
06/12/2023
On the N-gram Approximation of Pre-trained Language Models
Large pre-trained language models (PLMs) have shown remarkable performan...
research
∙
06/04/2023
An Information-Theoretic Analysis of Self-supervised Discrete Representations of Speech
Self-supervised representation learning for speech often involves a quan...
research
∙
05/27/2023
Weaker Than You Think: A Critical Look atWeakly Supervised Learning
Weakly supervised learning is a popular approach for training machine le...
research
∙
05/26/2023
Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation
Few-shot fine-tuning and in-context learning are two alternative strateg...
research
∙
05/23/2023
MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languages
In this paper, we present MasakhaPOS, the largest part-of-speech (POS) d...
research
∙
03/31/2023
ℰ KÚ [MASK]: Integrating Yorùbá cultural greetings into machine translation
This paper investigates the performance of massively multilingual neural...
research
∙
01/08/2023
Analyzing the Representational Geometry of Acoustic Word Embeddings
Acoustic word embeddings (AWEs) are vector representations such that dif...
research
∙
10/19/2022
A Data-Driven Investigation of Noise-Adaptive Utterance Generation with Linguistic Modification
In noisy environments, speech can be hard to understand for humans. Spok...
research
∙
09/14/2022
Integrating Form and Meaning: A Multi-Task Learning Model for Acoustic Word Embeddings
Models of acoustic word embeddings (AWEs) learn to map variable-length s...
research
∙
08/04/2022
Fusing Sentence Embeddings Into LSTM-based Autoregressive Language Models
Although masked language models are highly performant and widely adopted...
research
∙
06/15/2022
TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models
Transferring knowledge from one domain to another is of practical import...
research
∙
06/03/2022
Task-Adaptive Pre-Training for Boosting Learning With Noisy Labels: A Study on Text Classification for African Languages
For high-resource languages like English, text classification is a well-...
research
∙
05/27/2022
StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypes
Analyzing ethnic or religious bias is important for improving fairness, ...
research
∙
05/20/2022
Multilingual Normalization of Temporal Expressions with Masked Language Models
The detection and normalization of temporal expressions is an important ...
research
∙
05/18/2022
Exploiting Social Media Content for Self-Supervised Style Transfer
Recent research on style transfer takes inspiration from unsupervised ne...
research
∙
05/15/2022
Meta Self-Refinement for Robust Learning with Weak Supervision
Training deep neural networks (DNNs) with weak supervision has been a ho...
research
∙
04/28/2022
Placing M-Phasis on the Plurality of Hate: A Feature-Based Corpus of Hate Online
Even though hate speech (HS) online has been an important object of rese...
research
∙
04/22/2022
MCSE: Multimodal Contrastive Learning of Sentence Embeddings
Learning semantically meaningful sentence embeddings is an open problem ...
research
∙
04/20/2022
Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification
Incorrect labels in training data occur when human annotators make mista...
research
∙
04/13/2022
Multilingual Language Model Adaptive Fine-Tuning: A Study on African Languages
Multilingual pre-trained language models (PLMs) have demonstrated impres...
research
∙
04/13/2022
Call-sign recognition and understanding for noisy air-traffic transcripts using surveillance information
Air traffic control (ATC) relies on communication via speech between pil...
research
∙
04/06/2022
Knowledge Base Index Compression via Dimensionality and Precision Reduction
Recently neural network based approaches to knowledge-intensive NLP task...
research
∙
01/24/2022
Artefact Retrieval: Overview of NLP Models with Knowledge Base Access
Many NLP models gain performance by having access to a knowledge base. A...
research
∙
12/16/2021
CLIN-X: pre-trained language models and a study on cross-task transfer for concept extraction in the clinical domain
The field of natural language processing (NLP) has recently seen a large...
research
∙
10/27/2021
Enhancing Reinforcement Learning with discrete interfaces to learn the Dyck Language
Even though most interfaces in the real world are discrete, no efficient...
research
∙
10/18/2021
Label-Descriptive Patterns and their Application to Characterizing Classification Errors
State-of-the-art deep learning methods achieve human-like performance on...
research
∙
09/21/2021
How Familiar Does That Sound? Cross-Lingual Representational Similarity Analysis of Acoustic Word Embeddings
How do neural networks "perceive" speech sounds from unknown languages? ...
research
∙
09/19/2021
Preventing Author Profiling through Zero-Shot Multilingual Back-Translation
Documents as short as a single sentence may inadvertently reveal sensiti...
research
∙
07/19/2021
Integrating Unsupervised Data Generation into Self-Supervised Neural Machine Translation for Low-Resource Languages
For most language combinations, parallel data is either scarce or simply...
research
∙
07/18/2021
Exploring the Potential of Lexical Paraphrases for Mitigating Noise-Induced Comprehension Errors
Listening in noisy environments can be difficult even for individuals wi...
research
∙
07/08/2021
Proceedings of the First Workshop on Weakly Supervised Learning (WeaSuL)
Welcome to WeaSuL 2021, the First Workshop on Weakly Supervised Learning...
research
∙
06/16/2021
Do Acoustic Word Embeddings Capture Phonological Similarity? An Empirical Study
Several variants of deep neural networks have been successfully employed...
research
∙
06/14/2021
Modeling Profanity and Hate Speech in Social Media with Semantic Subspaces
Hate speech and profanity detection suffer from data sparsity, especiall...
research
∙
04/16/2021
To Share or not to Share: Predicting Sets of Sources for Model Transfer Learning
In low-resource settings, model transfer can help to overcome a lack of ...
research
∙
02/25/2021
ANEA: Distant Supervision for Low-Resource Named Entity Recognition
Distant supervision allows obtaining labeled training corpora for low-re...
research
∙
02/12/2021
Emoji-Based Transfer Learning for Sentiment Tasks
Sentiment tasks such as hate speech detection and sentiment analysis, es...
research
∙
01/24/2021
Analysing the Noise Model Error for Realistic Noisy Label Data
Distant and weak supervision allow to obtain large amounts of labeled tr...
research
∙
11/02/2020
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English
Transformer-based language models achieve high performance on various ta...
research
∙
10/28/2020
Fusion Models for Improved Visual Captioning
Visual captioning aims to generate textual descriptions given images. Tr...
research
∙
10/23/2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios
Current developments in natural language processing offer challenges and...
research
∙
10/23/2020
Adversarial Learning of Feature-based Meta-Embeddings
Certain embedding types outperform others in different scenarios, e.g., ...
research
∙
10/22/2020
Rediscovering the Slavic Continuum in Representations Emerging from Neural Models of Spoken Language Identification
Deep neural networks have been employed for various spoken language reco...
research
∙
10/07/2020
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages
Multilingual transformer models like mBERT and XLM-RoBERTa have obtained...
research
∙
10/06/2020
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers
Fine-tuning pre-trained contextualized embedding models has become an in...
research
∙
10/02/2020
HUMAN: Hierarchical Universal Modular ANnotator
A lot of real-world phenomena are complex and cannot be captured by sing...
research
∙
08/07/2020
Privacy Guarantees for De-identifying Text Transformations
Machine Learning approaches to Natural Language Processing tasks benefit...
research
∙
08/02/2020
Cross-Domain Adaptation of Spoken Language Identification for Related Languages: The Curious Case of Slavic Languages
State-of-the-art spoken language identification (LID) systems, which are...
research
∙
07/22/2020
Integrating Image Captioning with Rule-based Entity Masking
Given an image, generating its natural language description (i.e., capti...
research
∙
07/12/2020