research
∙
05/24/2023
ExpertPrompting: Instructing Large Language Models to be Distinguished Experts
The answering quality of an aligned large language model (LLM) can be dr...
share
research
∙
12/19/2022
Transferring General Multimodal Pretrained Models to Text Recognition
This paper proposes a new method, OFA-OCR, to transfer multimodal pretra...
research
∙
12/08/2022
OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Models
Generalist models, which are capable of performing diverse multi-modal t...
research
∙
11/02/2022
Chinese CLIP: Contrastive Vision-Language Pretraining in Chinese
The tremendous success of CLIP (Radford et al., 2021) has promoted the r...
research
∙
08/04/2022
Prompt Tuning for Generative Multimodal Pretrained Models
Prompt tuning has become a new paradigm for model tuning and it has demo...
research
∙
06/04/2022
Instance-wise Prompt Tuning for Pretrained Language Models
Prompt Learning has recently gained great popularity in bridging the gap...
research
∙
02/07/2022
Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
In this work, we pursue a unified paradigm for multimodal pretraining to...
research
∙
10/08/2021
M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
Recent expeditious developments in deep learning algorithms, distributed...
research
∙
05/31/2021
Exploring Sparse Expert Models and Beyond
Mixture-of-Experts (MoE) models can achieve promising results with outra...
research
∙
05/31/2021
Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation
Table-to-text generation refers to generating a descriptive text from a ...
research
∙
05/28/2021
Learning Relation Alignment for Calibrated Cross-modal Retrieval
Despite the achievements of large-scale multimodal pre-training approach...
research
∙
03/01/2021
M6: A Chinese Multimodal Pretrainer
In this work, we construct the largest dataset for multimodal pretrainin...
research
∙
03/30/2020
InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining
Multi-modal pretraining for learning high-level multi-modal representati...
research
∙
06/30/2019
Machine Reading Comprehension: a Literature Review
Machine reading comprehension aims to teach machines to understand a tex...
research
∙
06/10/2018
SciDTB: Discourse Dependency TreeBank for Scientific Abstracts
Annotation corpus for discourse relations benefits NLP tasks such as mac...
research
∙
06/10/2018