-
CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Model
In this paper, we introduce the Chinese corpus from CLUE organization, C...
03/03/2020 ∙ by Liang Xu, et al. ∙
0
∙
share
read it
-
CLUECorpus2020: A Large-scale Chinese Corpus for Pre-trainingLanguage Model
In this paper, we introduce the Chinese corpus from CLUE organization, C...
03/03/2020 ∙ by Liang Xu, et al. ∙
0
∙
share
read it
-
Pre-Training with Whole Word Masking for Chinese BERT
Bidirectional Encoder Representations from Transformers (BERT) has shown...
06/19/2019 ∙ by Yiming Cui, et al. ∙
0
∙
share
read it
-
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark
Artificial Intelligence (AI), along with the recent progress in biomedic...
06/15/2021 ∙ by Ningyu Zhang, et al. ∙
0
∙
share
read it
-
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training
The pre-trained neural models have recently achieved impressive performa...
04/19/2021 ∙ by Chenyi Lei, et al. ∙
0
∙
share
read it
-
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information
Recent pretraining models in Chinese neglect two important aspects speci...
06/30/2021 ∙ by Zijun Sun, et al. ∙
0
∙
share
read it
-
KLUE: Korean Language Understanding Evaluation
We introduce Korean Language Understanding Evaluation (KLUE) benchmark. ...
05/20/2021 ∙ by Sungjoon Park, et al. ∙
20
∙
share
read it
CLUE: A Chinese Language Understanding Evaluation Benchmark
04/13/2020 ∙ by Liang Xu, et al. ∙
0
∙
share
We introduce CLUE, a Chinese Language Understanding Evaluation benchmark. It contains eight different tasks, including single-sentence classification, sentence pair classification, and machine reading comprehension. We evaluate CLUE on a number of existing full-network pre-trained models for Chinese. We also include a small hand-crafted diagnostic test set designed to probe specific linguistic phenomena using different models, some of which are unique to Chinese. Along with CLUE, we release a large clean crawled raw text corpus that can be used for model pre-training. We release CLUE, baselines and pre-training dataset on Github.
READ FULL TEXT
Comments
There are no comments yet.