b'Nan Duan'

Learning to Generate Code Sketches

Traditional generative models are limited to predicting sequences of ter...
06/18/2021 ∙ by Daya Guo, et al. ∙ 0 ∙ share

read it
GEM: A General Evaluation Benchmark for Multimodal Tasks

In this paper, we present GEM as a General Evaluation benchmark for Mult...
06/18/2021 ∙ by Lin Su, et al. ∙ 0 ∙ share

read it
FastSeq: Make Sequence Generation Faster

Transformer-based models have made tremendous impacts in natural languag...
06/08/2021 ∙ by Yu Yan, et al. ∙ 4 ∙ share

read it
EL-Attention: Memory Efficient Lossless Attention for Generation

Transformer model with multi-head attention requires caching intermediat...
05/11/2021 ∙ by Yu Yan, et al. ∙ 0 ∙ share

read it
Poolingformer: Long Document Modeling with Pooling Attention

In this paper, we introduce a two-level attention schema, Poolingformer,...
05/10/2021 ∙ by Hang Zhang, et al. ∙ 16 ∙ share

read it
GODIVA: Generating Open-DomaIn Videos from nAtural Descriptions

Generating videos from text is a challenging task due to its high comput...
04/30/2021 ∙ by Chenfei Wu, et al. ∙ 14 ∙ share

read it
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval

Video-text retrieval plays an essential role in multi-modal research and...
04/18/2021 ∙ by Huaishao Luo, et al. ∙ 0 ∙ share

read it
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation

Now, the pre-training technique is ubiquitous in natural language proces...
04/16/2021 ∙ by Weizhen Qi, et al. ∙ 0 ∙ share

read it
WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach

Producing the embedding of a sentence in an unsupervised way is valuable...
04/05/2021 ∙ by Junjie Huang, et al. ∙ 0 ∙ share

read it
Mask Attention Networks: Rethinking and Strengthen Transformer

Transformer is an attention-based neural network, which consists of two ...
03/25/2021 ∙ by Zhihao Fan, et al. ∙ 0 ∙ share

read it
Distribution System Voltage Prediction from Smart Inverters using Decentralized Regression

As photovoltaic (PV) penetration continues to rise and smart inverter fu...
01/13/2021 ∙ by Zachary R. Atkins, et al. ∙ 0 ∙ share

read it
Syntax-Enhanced Pre-trained Model

We study the problem of leveraging the syntactic structure of text to en...
12/28/2020 ∙ by Zenan Xu, et al. ∙ 0 ∙ share

read it
An Enhanced Knowledge Injection Model for Commonsense Generation

Commonsense generation aims at generating plausible everyday scenario de...
12/01/2020 ∙ by Zhihao Fan, et al. ∙ 0 ∙ share

read it
ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine

In a sponsored search engine, generative retrieval models are recently p...
10/21/2020 ∙ by Weizhen Qi, et al. ∙ 9 ∙ share

read it
Neural Deepfake Detection with Factual Structure of Text

Deepfake detection, the task of automatically discriminating machine-gen...
10/15/2020 ∙ by Wanjun Zhong, et al. ∙ 0 ∙ share

read it
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space

In this paper, we propose a novel data augmentation method, referred to ...
10/04/2020 ∙ by Dayiheng Liu, et al. ∙ 0 ∙ share

read it
No Answer is Better Than Wrong Answer: A Reflection Model for Document Level Machine Reading Comprehension

The Natural Questions (NQ) benchmark set brings new challenges to Machin...
09/25/2020 ∙ by Xuguang Wang, et al. ∙ 0 ∙ share

read it
GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis

In this paper, we focus on the imbalance issue, which is rarely studied ...
09/22/2020 ∙ by Huaishao Luo, et al. ∙ 0 ∙ share

read it
GraphCodeBERT: Pre-training Code Representations with Data Flow

Pre-trained models for programming language have achieved dramatic empir...
09/17/2020 ∙ by Daya Guo, et al. ∙ 0 ∙ share

read it
Tag and Correct: Question aware Open Information Extraction with Two-stage Decoding

Question Aware Open Information Extraction (Question aware Open IE) take...
09/16/2020 ∙ by Martin Kuo, et al. ∙ 6 ∙ share

read it
Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder

Generating inferential texts about an event in different perspectives re...
06/15/2020 ∙ by Daya Guo, et al. ∙ 0 ∙ share

read it
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training

This paper presents a Multitask Multilingual Multimodal Pre-trained mode...
06/04/2020 ∙ by Haoyang Huang, et al. ∙ 7 ∙ share

read it
Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension

Natural Questions is a new challenging machine reading comprehension ben...
05/12/2020 ∙ by Bo Zheng, et al. ∙ 0 ∙ share

read it
A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videos

Procedural knowledge, which we define as concrete information about the ...
05/02/2020 ∙ by Frank F. Xu, et al. ∙ 6 ∙ share

read it
RikiNet: Reading Wikipedia Pages for Natural Question Answering

Reading long documents to answer open-domain questions remains challengi...
04/30/2020 ∙ by Dayiheng Liu, et al. ∙ 0 ∙ share

read it
Leveraging Declarative Knowledge in Text and First-Order Logic for Fine-Grained Propaganda Detection

We study the detection of propagandistic text fragments in news articles...
04/29/2020 ∙ by Ruize Wang, et al. ∙ 7 ∙ share

read it
Enhancing Answer Boundary Detection for Multilingual Machine Reading Comprehension

Multilingual pre-trained models could leverage the training data from a ...
04/29/2020 ∙ by Fei Yuan, et al. ∙ 0 ∙ share

read it
LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network

Verifying the correctness of a textual statement requires not only seman...
04/28/2020 ∙ by Wanjun Zhong, et al. ∙ 0 ∙ share

read it
A Heterogeneous Graph with Factual, Temporal and Logical Knowledge for Question Answering Over Dynamic Contexts

We study question answering over a dynamic textual environment. Although...
04/25/2020 ∙ by Wanjun Zhong, et al. ∙ 0 ∙ share

read it
Pre-training Text Representations as Meta Learning

Pre-training text representations has recently been shown to significant...
04/12/2020 ∙ by Shangwen Lv, et al. ∙ 0 ∙ share

read it
Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation

News headline generation aims to produce a short sentence to attract rea...
04/08/2020 ∙ by Dayiheng Liu, et al. ∙ 0 ∙ share

read it
Inferential Text Generation with Multiple Knowledge Sources and Meta-Learning

We study the problem of generating inferential texts of events for a var...
04/07/2020 ∙ by Daya Guo, et al. ∙ 9 ∙ share

read it
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

In this paper, we introduce XGLUE, a new benchmark dataset to train larg...
04/03/2020 ∙ by Yaobo Liang, et al. ∙ 0 ∙ share

read it
XGPT: Cross-modal Generative Pre-Training for Image Captioning

While many BERT-based cross-modal pre-trained models produce excellent r...
03/03/2020 ∙ by Qiaolin Xia, et al. ∙ 9 ∙ share

read it
CodeBERT: A Pre-Trained Model for Programming and Natural Languages

We present CodeBERT, a bimodal pre-trained model for programming languag...
02/19/2020 ∙ by Zhangyin Feng, et al. ∙ 0 ∙ share

read it
UniViLM: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation

We propose UniViLM: a Unified Video and Language pre-training Model for ...
02/15/2020 ∙ by Huaishao Luo, et al. ∙ 16 ∙ share

read it
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

We study the problem of injecting knowledge into large pre-trained model...
02/05/2020 ∙ by Ruize Wang, et al. ∙ 0 ∙ share

read it
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training

In this paper, we present a new sequence-to-sequence pre-training model ...
01/13/2020 ∙ by Yu Yan, et al. ∙ 0 ∙ share

read it
Multi-Task Learning for Conversational Question Answering over a Large-Scale Knowledge Base

We consider the problem of conversational question answering over a larg...
10/11/2019 ∙ by Tao Shen, et al. ∙ 0 ∙ share

read it
Neural Semantic Parsing in Low-Resource Settings with Back-Translation and Meta-Learning

Neural semantic parsing has achieved impressive results in recent years,...
09/12/2019 ∙ by Yibo Sun, et al. ∙ 0 ∙ share

read it
Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering

Commonsense question answering aims to answer questions which require ba...
09/09/2019 ∙ by Shangwen Lv, et al. ∙ 0 ∙ share

read it
Reasoning Over Semantic-Level Graph for Fact Checking

We study fact-checking in this paper, which aims to verify a textual cla...
09/09/2019 ∙ by Wanjun Zhong, et al. ∙ 17 ∙ share

read it
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks

We present Unicoder, a universal language encoder that is insensitive to...
09/03/2019 ∙ by Haoyang Huang, et al. ∙ 0 ∙ share

read it
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training

We propose Unicoder-VL, a universal encoder that aims to learn joint rep...
08/16/2019 ∙ by Gen Li, et al. ∙ 7 ∙ share

read it
A Tensorized Transformer for Language Modeling

Latest development of neural models has connected the encoder and decode...
06/24/2019 ∙ by Xindian Ma, et al. ∙ 0 ∙ share

read it
Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing

In this paper, we present an approach to incorporate retrieved datapoint...
06/17/2019 ∙ by Daya Guo, et al. ∙ 0 ∙ share

read it
Deep Reason: A Strong Baseline for Real-World Visual Reasoning

This paper presents a strong baseline for real-world visual reasoning (G...
05/24/2019 ∙ by Chenfei Wu, et al. ∙ 0 ∙ share

read it
PasteGAN: A Semi-Parametric Method to Generate Image from Scene Graph

Despite some exciting progress on high-quality image generation from str...
05/05/2019 ∙ by Yikang Li, et al. ∙ 0 ∙ share

read it
Pretraining-Based Natural Language Generation for Text Summarization

In this paper, we propose a novel pretraining-based encoder-decoder fram...
02/25/2019 ∙ by Haoyu Zhang, et al. ∙ 8 ∙ share

read it
Knowledge-Aware Conversational Semantic Parsing Over Web Tables

Conversational semantic parsing over tables requires knowledge acquiring...
09/12/2018 ∙ by Yibo Sun, et al. ∙ 0 ∙ share

read it

Nan Duan

Featured Co-authors