research
∙
12/09/2022
BigScience: A Case Study in the Social Construction of a Multilingual Large Language Model
The BigScience Workshop was a value-driven initiative that spanned one a...
share
research
∙
05/20/2022
On the Trade-off between Redundancy and Local Coherence in Summarization
Extractive summarization systems are known to produce poorly coherent an...
research
∙
12/20/2021
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP
What are the units of text that we want to model? From bytes to multi-wo...
research
∙
11/12/2021
Speeding Up Entmax
Softmax is the de facto standard in modern neural networks for language ...
research
∙
11/04/2021
Unsupervised and Distributional Detection of Machine-Generated Text
The power of natural language generation models has provoked a flurry of...
research
∙
10/20/2021
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters
We consider the problem of multilingual unsupervised machine translation...
research
∙
06/22/2021
On the Evaluation of Machine Translation for Terminology Consistency
As neural machine translation (NMT) systems become an important part of ...
research
∙
04/16/2021
Unsupervised Extractive Summarization by Human Memory Simulation
Summarization systems face the core challenge of identifying and selecti...
research
∙
03/02/2021
The Rediscovery Hypothesis: Language Models Need to Meet Linguistics
There is an ongoing debate in the NLP community whether modern language ...
research
∙
08/06/2020
A Multilingual Neural Machine Translation Model for Biomedical Data
We release a multilingual neural machine translation model, which can be...
research
∙
04/30/2020
Self-Supervised and Controlled Multi-Document Opinion Summarization
We address the problem of unsupervised abstractive summarization of coll...
research
∙
11/12/2019
Character-based NMT with Transformer
Character-based translation has several appealing advantages, but its pe...
research
∙
06/09/2017
A Maximum Matching Algorithm for Basis Selection in Spectral Learning
We present a solution to scale spectral algorithms for learning sequence...
research
∙
01/13/2017
What Can I Do Now? Guiding Users in a World of Automated Decisions
More and more processes governing our lives use in some part an automati...
research
∙
08/31/2016
The Generalized Smallest Grammar Problem
The Smallest Grammar Problem -- the problem of finding the smallest cont...
research
∙
07/19/2016
Discriminating between similar languages in Twitter using label propagation
Identifying the language of social media messages is an important first ...
research
∙
07/18/2016