research
∙
05/10/2023
Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception
We present Integrated Multimodal Perception (IMP), a simple and scalable...
share
research
∙
11/03/2022
Scaling Multimodal Pre-Training via Cross-Modality Gradient Harmonization
Self-supervised pre-training recently demonstrates success on large-scal...
research
∙
09/14/2022
PaLI: A Jointly-Scaled Multilingual Language-Image Model
Effective scaling and a flexible task interface enable large language mo...
research
∙
04/22/2021
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
We present a framework for learning multimodal representations from unla...
research
∙
11/18/2020
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Neuro-symbolic representations have proved effective in learning structu...
research
∙
11/28/2018
Multi-level Multimodal Common Semantic Space for Image-Phrase Grounding
We address the problem of phrase grounding by learning a multi-level com...
research
∙
10/26/2017