research
∙
02/27/2023
Language Is Not All You Need: Aligning Perception with Language Models
A big convergence of language, multimodal perception, action, and world ...
share
research
∙
12/20/2022
A Length-Extrapolatable Transformer
Position modeling plays a critical role in Transformers. In this paper, ...
research
∙
11/23/2022
TorchScale: Transformers at Scale
Large Transformers have achieved state-of-the-art performance across man...
research
∙
10/26/2022
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
In this paper, we elaborate upon recipes for building multilingual repre...
research
∙
10/13/2022
Language Model Decoding as Likelihood-Utility Alignment
A critical component of a successful language generation pipeline is the...
research
∙
10/12/2022
Foundation Transformers
A big convergence of model architectures across language, vision, speech...
research
∙
04/20/2022
On the Representation Collapse of Sparse Mixture of Experts
Sparse mixture of experts provides larger model capacity while requiring...
research
∙
04/03/2022
On Efficiently Acquiring Annotations for Multilingual Models
When tasked with supporting multiple languages for a given problem, two ...
research
∙
10/16/2021
Invariant Language Modeling
Modern pretrained language models are critical components of NLP pipelin...
research
∙
11/15/2020
To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints
State of the art research for date-time entity extraction from text is t...
research
∙
02/23/2020
ScopeIt: Scoping Task Relevant Sentences in Documents
Intelligent assistants like Cortana, Siri, Alexa, and Google Assistant a...
research
∙
08/19/2019
Bilingual Lexicon Induction with Semi-supervision in Non-Isometric Embedding Spaces
Recent work on bilingual lexicon induction (BLI) has frequently depended...
research
∙
04/20/2019
Compression and Localization in Reinforcement Learning for ATARI Games
Deep neural networks have become commonplace in the domain of reinforcem...
research
∙
01/05/2018