research
∙
06/07/2023
Unbalanced Optimal Transport for Unbalanced Word Alignment
Monolingual word alignment is crucial to model semantic interactions bet...
share
research
∙
05/29/2023
Transformer Language Models Handle Word Frequency in Prediction Head
Prediction head is a crucial component of Transformer language models. D...
research
∙
02/01/2023
Feed-Forward Blocks Control Contextualization in Masked Language Models
Understanding the inner workings of neural network models is a crucial s...
research
∙
12/19/2022
Norm of word embedding encodes information gain
Distributed representations of words encode lexical semantic information...
research
∙
11/11/2022
Improving word mover's distance by leveraging self-attention matrix
Measuring the semantic similarity between two sentences is still an impo...
research
∙
10/24/2022
Subspace-based Set Operations on a Pre-trained Word Embedding Space
Word embedding is a fundamental technology in natural language processin...
research
∙
09/28/2021
Instance-Based Neural Dependency Parsing
Interpretable rationales for model predictions are crucial in practical ...
research
∙
09/15/2021
Incorporating Residual and Normalization Layers into Analysis of Masked Language Models
Transformer architecture has become ubiquitous in the natural language p...
research
∙
05/18/2021
Revisiting Additive Compositionality: AND, OR and NOT Operations with Word Embeddings
It is well-known that typical word embedding methods such as Word2Vec an...
research
∙
03/01/2021
Computationally Efficient Wasserstein Loss for Structured Labels
The problem of estimating the probability distribution of labels has bee...
research
∙
12/08/2020
Efficient Estimation of Influence of a Training Instance
Understanding the influence of a training instance on a neural network m...
research
∙
11/03/2020
Modeling Event Salience in Narratives via Barthes' Cardinal Functions
Events in a narrative differ in salience: some are more important to the...
research
∙
06/08/2020
Evaluation Criteria for Instance-based Explanation
Explaining predictions made by complex machine learning models helps use...
research
∙
04/30/2020
Word Rotator's Distance: Decomposing Vectors Gives Better Representations
One key principle for assessing semantic similarity between texts is to ...
research
∙
04/29/2020
Instance-Based Learning of Span Representations: A Case Study through Named Entity Recognition
Interpretable rationales for model predictions play a critical role in p...
research
∙
04/29/2020
Utterance Pair Scoring for Noisy Dialogue Data Filtering
Filtering noisy training data is one of the key approaches to improving ...
research
∙
04/21/2020
Attention Module is Not Only a Weight: Analyzing Transformers with Vector Norms
Because attention modules are core components of Transformer-based model...
research
∙
09/04/2018
Pointwise HSIC: A Linear-Time Kernelized Co-occurrence Norm for Sparse Linguistic Expressions
In this paper, we propose a new kernel-based co-occurrence measure that ...
research
∙
05/15/2018