Thomas Scialom

research

∙ 08/25/2023

Nougat: Neural Optical Understanding for Academic Documents

Scientific knowledge is predominantly stored in books and scientific jou...

0 Lukas Blecher, et al. ∙

research

∙ 08/24/2023

Code Llama: Open Foundation Models for Code

We release Code Llama, a family of large language models for code based ...

0 Baptiste Roziere, et al. ∙

research

∙ 07/18/2023

Llama 2: Open Foundation and Fine-Tuned Chat Models

In this work, we develop and release Llama 2, a collection of pretrained...

0 Hugo Touvron, et al. ∙

research

∙ 02/15/2023

Augmented Language Models: a Survey

This survey reviews works in which language models (LMs) are augmented w...

0 Grégoire Mialon, et al. ∙

research

∙ 02/09/2023

Toolformer: Language Models Can Teach Themselves to Use Tools

Language models (LMs) exhibit remarkable abilities to solve new tasks fr...

1 Timo Schick, et al. ∙

research

∙ 01/26/2023

LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization

Text Summarization is a popular task and an active area of research for ...

0 Laura Nguyen, et al. ∙

research

∙ 12/19/2022

Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor

Instruction tuning enables pretrained language models to perform new tas...

0 Or Honovich, et al. ∙

research

∙ 11/16/2022

Galactica: A Large Language Model for Science

Information overload is a major obstacle to scientific progress. The exp...

13 Ross Taylor, et al. ∙

research

∙ 11/02/2022

RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question

Existing metrics for evaluating the quality of automatically generated q...

8 Alireza Mohammadshahi, et al. ∙

research

∙ 05/24/2022

Continual-T0: Progressively Instructing 50+ Tasks to Language Models Without Forgetting

Recent work on large language models relies on the intuition that most n...

0 Thomas Scialom, et al. ∙

research

∙ 04/25/2022

Which Discriminator for Cooperative Text Generation?

Language models generate texts by successively predicting probability di...

0 Antoine Chaffin, et al. ∙

research

∙ 04/11/2022

TRUE: Re-evaluating Factual Consistency Evaluation

Grounded text generation systems often generate text that contains factu...

2 Or Honovich, et al. ∙

research

∙ 01/28/2022

Generative Cooperative Networks for Natural Language Generation

Generative Adversarial Networks (GANs) have known a tremendous success f...

0 Sylvain Lamprier, et al. ∙

research

∙ 10/18/2021

BEAMetrics: A Benchmark for Language Generation Evaluation Evaluation

Natural language processing (NLP) systems are increasingly trained to ge...

7 Thomas Scialom, et al. ∙

research

∙ 09/02/2021

Skim-Attention: Learning to Focus via Document Layout

Transformer-based pre-training techniques of text and layout have proven...

0 Laura Nguyen, et al. ∙

research

∙ 08/28/2021

QACE: Asking Questions to Evaluate an Image Caption

In this paper, we propose QACE, a new metric based on Question Answering...

0 Hwanhee Lee, et al. ∙

research

∙ 06/11/2021

To Beam Or Not To Beam: That is a Question of Cooperation for Language GANs

Due to the discrete nature of words, language GANs require to be optimiz...

0 Thomas Scialom, et al. ∙

research

∙ 04/15/2021

Rethinking Automatic Evaluation in Sentence Simplification

Automatic evaluation remains an open research question in Natural Langua...

0 Thomas Scialom, et al. ∙

research

∙ 04/15/2021

Data-QuestEval: A Referenceless Metric for Data to Text Semantic Evaluation

In this paper, we explore how QuestEval, which is a Text-vs-Text metric,...

0 Clément Rebuffel, et al. ∙

research

∙ 03/23/2021

SAFEval: Summarization Asks for Fact-based Evaluation

Summarization evaluation remains an open research problem: current metri...

0 Thomas Scialom, et al. ∙

research

∙ 10/23/2020

Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering

Coupled with the availability of large scale datasets, deep learning arc...

0 Arij Riabi, et al. ∙

research

∙ 10/07/2020

Toward Stance-based Personas for Opinionated Dialogues

In the context of chit-chat dialogues it has been shown that endowing sy...

0 Thomas Scialom, et al. ∙

research

∙ 07/02/2020

Project PIAF: Building a Native French Question-Answering Dataset

Motivated by the lack of data for non-English languages, in particular f...

0 Rachel Keraron, et al. ∙

research

∙ 06/08/2020

ColdGANs: Taming Language GANs with Cautious Sampling Strategies

Training regimes based on Maximum Likelihood Estimation (MLE) suffer fro...

0 Thomas Scialom, et al. ∙

research

∙ 04/30/2020

MLSUM: The Multilingual Summarization Corpus

We present MLSUM, the first large-scale MultiLingual SUMmarization datas...

0 Thomas Scialom, et al. ∙

research

∙ 02/25/2020

BERT Can See Out of the Box: On the Cross-modal Transferability of Text Representations

Pre-trained language models such as BERT have recently contributed to si...

0 Thomas Scialom, et al. ∙

research

∙ 02/24/2020

Discriminative Adversarial Search for Abstractive Summarization

We introduce a novel approach for sequence decoding, Discriminative Adve...

0 Thomas Scialom, et al. ∙

research

∙ 11/08/2019

Ask to Learn: A Study on Curiosity-driven Question Generation

We propose a novel text generation task, namely Curiosity-driven Questio...

0 Thomas Scialom, et al. ∙

research

∙ 09/04/2019

Answers Unite! Unsupervised Metrics for Reinforced Summarization Models

Abstractive summarization approaches based on Reinforcement Learning (RL...

0 Thomas Scialom, et al. ∙

Thomas Scialom

Featured Co-authors