research
∙
08/14/2023
CausalLM is not optimal for in-context learning
Recent empirical evidence indicates that transformer based in-context le...
share
research
∙
09/14/2022
PaLI: A Jointly-Scaled Multilingual Language-Image Model
Effective scaling and a flexible task interface enable large language mo...
research
∙
09/12/2022
PreSTU: Pre-Training for Scene-Text Understanding
The ability to read and reason about texts in an image is often lacking ...
research
∙
03/31/2022
Scaling Up Models and Data with and
Recent neural network-based language models have benefited greatly from ...
research
∙
05/28/2021
Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning
Despite recent advances in its theoretical understanding, there still re...
research
∙
10/07/2020
TeaForN: Teacher-Forcing with N-grams
Sequence generation models trained with teacher-forcing suffer from issu...
research
∙
06/15/2020
Multi-Image Summarization: Textual Summary from a Set of Cohesive Images
Multi-sentence summarization is a well studied problem in NLP, while gen...
research
∙
09/26/2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Increasing model size when pretraining natural language representations ...
research
∙
09/23/2019
Multi-stage Pretraining for Abstractive Summarization
Neural models for abstractive summarization tend to achieve the best per...
research
∙
12/22/2016