research
∙
11/03/2022
Could Giant Pretrained Image Models Extract Universal Representations?
Frozen pretrained models have become a viable alternative to the pretrai...
share
research
∙
06/09/2022
On Data Scaling in Masked Image Modeling
An important goal of self-supervised learning is to enable model pre-tra...
research
∙
12/29/2021
A Simple Baseline for Zero-shot Semantic Segmentation with Pre-trained Vision-language Model
Recently, zero-shot image classification by vision-language pre-training...
research
∙
11/18/2021
SimMIM: A Simple Framework for Masked Image Modeling
This paper presents SimMIM, a simple framework for masked image modeling...
research
∙
11/18/2021
Swin Transformer V2: Scaling Up Capacity and Resolution
We present techniques for scaling Swin Transformer up to 3 billion param...
research
∙
11/04/2021
Bootstrap Your Object Detector via Mixed Training
We introduce MixTraining, a new training paradigm for object detection t...
research
∙
05/10/2021
Self-Supervised Learning with Swin Transformers
We are witnessing a modeling shift from CNN to Transformers in computer ...
research
∙
03/25/2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
This paper presents a new vision Transformer, called Swin Transformer, t...
research
∙
11/19/2020
Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning
Contrastive learning methods for unsupervised visual representation lear...
research
∙
06/25/2020
Parametric Instance Classification for Unsupervised Visual Feature Learning
This paper presents parametric instance classification (PIC) for unsuper...
research
∙
03/26/2020