research
∙
08/08/2023
Continual Pre-Training of Large Language Models: How to (re)warm your model?
Large language models (LLMs) are routinely pre-trained on billions of to...
share
research
∙
07/25/2023
ARB: Advanced Reasoning Benchmark for Large Language Models
Large Language Models (LLMs) have demonstrated remarkable performance on...
research
∙
10/26/2022
Broken Neural Scaling Laws
We present a smoothly broken power law functional form that accurately m...
research
∙
10/23/2022
Automated Essay Scoring using Transformers
Despite being investigated for over five decades, the task of automated ...
research
∙
10/01/2022
MALM: Mixing Augmented Language Modeling for Zero-Shot Machine Translation
Large pre-trained language models have brought remarkable progress in NL...
research
∙
06/07/2022
cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation
Vision-and-language tasks are gaining popularity in the research communi...
research
∙
05/30/2022
Temporal Latent Bottleneck: Synthesis of Fast and Slow Processing Mechanisms in Sequence Learning
Recurrent neural networks have a strong inductive bias towards learning ...
research
∙
06/01/2021
ViTA: Visual-Linguistic Translation by Aligning Object Tags
Multimodal Machine Translation (MMT) enriches the source text with visua...
research
∙
06/01/2021
Volta at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables using TAPAS and Transfer Learning
Tables are widely used in various kinds of documents to present informat...
research
∙
06/01/2021