research
∙
06/05/2023
DecompX: Explaining Transformers Decisions by Propagating Token Decomposition
An emerging solution for explaining Transformer-based models is to use v...
share
research
∙
02/06/2023
Guide the Learner: Controlling Product of Experts Debiasing Method Based on Token Attribution Similarities
Several proposals have been put forward in recent years for improving ou...
research
∙
02/01/2023
An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning
Parameter-efficient fine-tuning approaches have recently garnered a lot ...
research
∙
11/10/2022
BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning
Current pre-trained language models rely on large datasets for achieving...
research
∙
11/07/2022
Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language Inference
It has been shown that NLI models are usually biased with respect to the...
research
∙
05/06/2022
GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers
There has been a growing interest in interpreting the underlying dynamic...
research
∙
03/17/2022
On the Importance of Data Size in Probing Fine-tuned Models
Several studies have investigated the reasons behind the effectiveness o...
research
∙
03/16/2022
AdapLeR: Speeding up Inference by Adaptive Length Reduction
Pre-trained language models have shown stellar performance in various do...
research
∙
10/09/2021
An Isotropy Analysis in the Multilingual BERT Embedding Space
Several studies have explored various advantages of multilingual pre-tra...
research
∙
09/13/2021
Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations
Most of the recent works on probing representations have focused on BERT...
research
∙
09/10/2021
How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy
It is widely accepted that fine-tuning pre-trained language models usual...
research
∙
09/01/2021
Don't Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation Techniques
Existing techniques for mitigating dataset bias often leverage a biased ...
research
∙
06/02/2021
A Cluster-based Approach for Improving Isotropy in Contextual Embedding Space
The representation degeneration problem in Contextual Word Representatio...
research
∙
04/03/2021
Exploring the Role of BERT Token Representations to Explain Sentence Probing Results
Several studies have been carried out on revealing linguistic features c...
research
∙
10/13/2020
XL-WiC: A Multilingual Benchmark for Evaluating Semantic Contextualization
The ability to correctly model distinct meanings of a word is crucial fo...
research
∙
08/26/2020
Language Models and Word Sense Disambiguation: An Overview and Analysis
Transformer-based language models have taken many fields in NLP by storm...
research
∙
05/01/2020
Will-They-Won't-They: A Very Large Dataset for Stance Detection on Twitter
We present a new challenging stance detection dataset, called Will-They-...
research
∙
04/30/2020
WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context
In this paper, we present WiC-TSV (Target Sense Verification for Words i...
research
∙
09/30/2019
On the Importance of the Kullback-Leibler Divergence Term in Variational Autoencoders for Text Generation
Variational Autoencoders (VAEs) are known to suffer from learning uninfo...
research
∙
04/05/2019
Generating Knowledge Graph Paths from Textual Definitions using Sequence-to-Sequence Models
We present a novel method for mapping unrestricted text to knowledge gra...
research
∙
11/12/2018
Unseen Word Representation by Aligning Heterogeneous Lexical Semantic Spaces
Word embedding techniques heavily rely on the abundance of training data...
research
∙
10/29/2018
A Pragmatic Guide to Geoparsing Evaluation
Empirical methods in geoparsing have thus far lacked a standard evaluati...
research
∙
08/28/2018
Card-660: Cambridge Rare Word Dataset - a Reliable Benchmark for Infrequent Word Representation Models
Rare word representation has recently enjoyed a surge of interest, owing...
research
∙
08/28/2018
WiC: 10,000 Example Pairs for Evaluating Context-Sensitive Representations
By design, word embeddings are unable to model the dynamic nature of wor...
research
∙
08/23/2018
Mapping Text to Knowledge Graph Entities using Multi-Sense LSTMs
This paper addresses the problem of mapping natural language text to kno...
research
∙
07/02/2018
The Interplay between Lexical Resources and Natural Language Processing
Incorporating linguistic, world and common sense knowledge into AI/NLP s...
research
∙
10/18/2017
Towards a Seamless Integration of Word Senses into Downstream NLP Applications
Lexical ambiguity can impede NLP systems from accurate understanding of ...
research
∙
07/24/2017
Learning Rare Word Representations using Semantic Bridging
We propose a methodology that adapts graph embedding techniques (DeepWal...
research
∙
07/06/2017
On the Role of Text Preprocessing in Neural Network Architectures: An Evaluation Study on Text Categorization and Sentiment Analysis
In this paper we investigate the impact of simple text preprocessing dec...
research
∙
08/05/2016
De-Conflated Semantic Representations
One major deficiency of most semantic representation techniques is that ...
research
∙
08/02/2016