research
∙
09/22/2020
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
Evaluation metrics play a vital role in the growth of an area as it defi...
share
research
∙
02/28/2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
We propose to pre-train a unified language model for both autoencoding a...
research
∙
02/25/2020
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
Pre-trained language models (e.g., BERT (Devlin et al., 2018) and its va...
research
∙
02/19/2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
We present CodeBERT, a bimodal pre-trained model for programming languag...
research
∙
02/05/2020
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
We study the problem of injecting knowledge into large pre-trained model...
research
∙
01/13/2020
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training
In this paper, we present a new sequence-to-sequence pre-training model ...
research
∙
12/31/2019
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Pre-training techniques have been verified successfully in a variety of ...
research
∙
11/07/2019
Improving Grammatical Error Correction with Machine Translation Pairs
We propose a novel data synthesis method to generate diverse error-corre...
research
∙
09/09/2019
Reasoning Over Semantic-Level Graph for Fact Checking
We study fact-checking in this paper, which aims to verify a textual cla...
research
∙
05/08/2019
Unified Language Model Pre-training for Natural Language Understanding and Generation
This paper presents a new Unified pre-trained Language Model (UniLM) tha...
research
∙
03/05/2019
TableBank: Table Benchmark for Image-based Table Detection and Recognition
We present TableBank, a new image-based table detection and recognition ...
research
∙
05/27/2018
