research
∙
04/17/2023
Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca
Large Language Models (LLMs), such as ChatGPT and GPT-4, have revolution...
share
research
∙
04/03/2023
MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model
In natural language processing, pre-trained language models have become ...
research
∙
12/15/2022
Gradient-based Intra-attention Pruning on Pre-trained Language Models
Pre-trained language models achieve superior performance, but they are c...
research
∙
04/13/2022
HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection
The same multi-word expressions may have different meanings in different...
research
∙
04/11/2022
HFL at SemEval-2022 Task 8: A Linguistics-inspired Regression Model with Data Augmentation for Multilingual News Similarity
This paper describes our system designed for SemEval-2022 Task 8: Multil...
research
∙
03/30/2022
TextPruner: A Model Pruning Toolkit for Pre-Trained Language Models
Pre-trained language models have been prevailed in natural language proc...
research
∙
03/14/2022
PERT: Pre-training BERT with Permuted Language Model
Pre-trained Language Models (PLMs) have been widely used in various natu...
research
∙
02/28/2022
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training
Multilingual pre-trained language models (MPLMs) not only can handle tas...
research
∙
02/28/2022
CINO: A Chinese Minority Pre-trained Language Model
Multilingual pre-trained language models have shown impressive performan...
research
∙
06/08/2021
Adversarial Training for Machine Reading Comprehension with Virtual Embeddings
Adversarial training (AT) as a regularization method has proved its effe...
research
∙
06/03/2021
Bilingual Alignment Pre-training for Zero-shot Cross-lingual Transfer
Multilingual pre-trained models have achieved remarkable transfer perfor...
research
∙
04/29/2020
Benchmarking Robustness of Machine Reading Comprehension Models
Machine Reading Comprehension (MRC) is an important testbed for evaluati...
research
∙
04/07/2020
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension
Owing to the continuous contributions by the Chinese NLP community, more...
research
∙
02/28/2020
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing
In this paper, we introduce TextBrewer, an open-source knowledge distill...
research
∙
02/07/2020
Poisson Kernel Avoiding Self-Smoothing in Graph Convolutional Networks
Graph convolutional network (GCN) is now an effective tool to deal with ...
research
∙
11/09/2019
Improving Machine Reading Comprehension via Adversarial Training
Adversarial training (AT) as a regularization method has proved its effe...
research
∙
06/22/2019
Explainable Knowledge Graph-based Recommendation via Deep Reinforcement Learning
This paper studies recommender systems with knowledge graphs, which can ...
research
∙
06/19/2019