research
∙
09/09/2023
Neurons in Large Language Models: Dead, N-gram, Positional
We analyze a family of large language models in such a lightweight manne...
share
research
∙
05/19/2023
HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translation
Hallucinations in machine translation are translations that contain info...
research
∙
12/16/2022
Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Better
While the problem of hallucinations in neural machine translation has lo...
research
∙
08/10/2022
Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translation
Although the problem of hallucinations in neural machine translation (NM...
research
∙
09/03/2021
Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT
Differently from the traditional statistical MT that decomposes the tran...
research
∙
10/21/2020
Analyzing the Source and Target Contributions to Predictions in Neural Machine Translation
In Neural Machine Translation (and, more generally, conditional language...
research
∙
10/06/2020
Embedding Words in Non-Vector Space with Unsupervised Graph Learning
It has become a de-facto standard to represent words as elements of a ve...
research
∙
03/27/2020
Information-Theoretic Probing with Minimum Description Length
To measure how well pretrained representations encode some linguistic pr...
research
∙
11/01/2019
Sequence Modeling with Unconstrained Generation Order
The dominant approach to sequence generation is to produce a sequence in...
research
∙
10/29/2019
BPE-Dropout: Simple and Effective Subword Regularization
Subword segmentation is widely used to address the open vocabulary probl...
research
∙
09/03/2019
Context-Aware Monolingual Repair for Neural Machine Translation
Modern sentence-level NMT systems often produce plausible translations o...
research
∙
09/03/2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives
We seek to understand how the representations of individual tokens and t...
research
∙
05/23/2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned
Multi-head self-attention is a key component of the Transformer, a state...
research
∙
05/15/2019
When a Good Translation is Wrong in Context: Context-Aware Machine Translation Improves on Deixis, Ellipsis, and Lexical Cohesion
Though machine translation errors caused by the lack of context beyond o...
research
∙
10/04/2018
A Large-Scale Test Set for the Evaluation of Context-Aware Pronoun Translation in Neural Machine Translation
The translation of pronouns presents a special challenge to machine tran...
research
∙
05/25/2018