research
∙
05/08/2023
Augmented Large Language Models with Parametric Knowledge Guiding
Large Language Models (LLMs) have significantly advanced natural languag...
share
research
∙
02/03/2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
Recently multi-lingual pre-trained language models (PLM) such as mBERT a...
research
∙
12/15/2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Dense retrieval aims to map queries and passages into low-dimensional ve...
research
∙
06/21/2022
Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation
The Differentiable Search Index (DSI) is a new, emerging paradigm for in...
research
∙
06/01/2022
Task-Specific Expert Pruning for Sparse Mixture-of-Experts
The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pr...
research
∙
06/01/2022
Negative Sampling for Contrastive Representation Learning: A Review
The learn-to-compare paradigm of contrastive representation learning (CR...
research
∙
05/07/2022
Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding
Although spoken language understanding (SLU) has achieved great success ...
research
∙
02/10/2022
NÜWA-LIP: Language Guided Image Inpainting with Defect-free VQGAN
Language guided image inpainting aims to fill in the defective regions o...
research
∙
11/24/2021
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion
This paper presents a unified multimodal pre-trained model called NÜWA t...
research
∙
10/16/2021
Multimodal Dialogue Response Generation
Responsing with image has been recognized as an important capability for...
research
∙
10/14/2021
Finetuning Large-Scale Pre-trained Language Models for Conversational Recommendation with Knowledge Graph
In this paper, we present a pre-trained language model (PLM) based frame...
research
∙
12/28/2020
Syntax-Enhanced Pre-trained Model
We study the problem of leveraging the syntactic structure of text to en...
research
∙
02/19/2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
We present CodeBERT, a bimodal pre-trained model for programming languag...
research
∙
02/05/2020
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
We study the problem of injecting knowledge into large pre-trained model...
research
∙
04/21/2019
