research
∙
03/27/2022
Mugs: A Multi-Granular Self-Supervised Learning Framework
In self-supervised learning, multi-granular features are heavily desired...
share
research
∙
11/22/2021
MetaFormer is Actually What You Need for Vision
Transformers have shown great potential in computer vision tasks. A comm...
research
∙
06/22/2021
LV-BERT: Exploiting Layer Variety for BERT
Modern pre-trained language models are mostly built upon backbones stack...
research
∙
01/28/2021
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Transformers, which are popular for language modeling, have been explore...
research
∙
08/06/2020
ConvBERT: Improving BERT with Span-based Dynamic Convolution
Pre-trained language models like BERT and its variants have recently ach...
research
∙
02/11/2020
ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning
Recent powerful pre-trained language models have achieved remarkable per...
research
∙
10/25/2019
Heterogeneous Graph Learning for Visual Commonsense Reasoning
Visual commonsense reasoning task aims at leading the research field int...
research
∙
03/08/2019
Knowledge-Embedded Routing Network for Scene Graph Generation
To understand a scene in depth not only involves locating/recognizing in...
research
∙
07/02/2018