research
∙
09/20/2023
Create and Find Flatness: Building Flat Training Spaces in Advance for Continual Learning
Catastrophic forgetting remains a critical challenge in the field of con...
share
research
∙
10/18/2022
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning
Existing zero-shot cross-lingual transfer methods rely on parallel corpo...
research
∙
04/13/2021
Bridging the Gap Between Clean Data Training and Real-World Inference for Spoken Language Understanding
Spoken language understanding (SLU) system usually consists of various p...
research
∙
03/07/2021
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees
Pre-trained language models like BERT achieve superior performances in v...
research
∙
10/14/2020
AutoADR: Automatic Model Design for Ad Relevance
Large-scale pre-trained models have attracted extensive attention in the...
research
∙
04/08/2020
Improving BERT with Self-Supervised Attention
One of the most popular paradigms of applying large, pre-trained NLP mod...
research
∙
12/23/2019