research
∙
09/09/2023
Neurons in Large Language Models: Dead, N-gram, Positional
We analyze a family of large language models in such a lightweight manne...
share
research
∙
09/05/2023
Automating Behavioral Testing in Machine Translation
Behavioral testing in NLP allows fine-grained evaluation of systems by e...
research
∙
05/21/2023
Explaining How Transformers Use Context to Build Predictions
Language Generation Models produce words based on the previous context. ...
research
∙
10/06/2022
Toxicity in Multilingual Machine Translation at Scale
Machine Translation systems can produce different types of errors, some ...
research
∙
05/23/2022
Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformer
In Neural Machine Translation (NMT), each token prediction is conditione...
research
∙
04/19/2022
On the Locality of Attention in Direct Speech Translation
Transformers have achieved state-of-the-art results across multiple NLP ...
research
∙
03/08/2022
Measuring the Mixing of Contextual Information in the Transformer
The Transformer architecture aggregates input information through the se...
research
∙
09/13/2021
Attention Weights in Transformer NMT Fail Aligning Words Between Sequences but Largely Explain Model Predictions
This work proposes an extensive analysis of the Transformer architecture...
research
∙
12/24/2020
Gender Bias in Multilingual Neural Machine Translation: The Architecture Matters
Multilingual Neural Machine Translation architectures mainly differ in t...
research
∙
06/16/2020