research
∙
08/22/2022
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
A big convergence of language, vision, and multimodal pretraining is eme...
share
research
∙
08/12/2022
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers
Masked image modeling (MIM) has demonstrated impressive results in self-...
research
∙
06/15/2021
BEiT: BERT Pre-Training of Image Transformers
We introduce a self-supervised vision representation model BEiT, which s...
research
∙
02/28/2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
We propose to pre-train a unified language model for both autoencoding a...
research
∙
02/25/2020
