research
∙
06/28/2023
SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills
Traditional multitask learning methods basically can only exploit common...
share
research
∙
05/26/2023
Improved Visual Story Generation with Adaptive Context Modeling
Diffusion models developed on top of powerful text-to-image generation m...
research
∙
02/20/2023
STOA-VLP: Spatial-Temporal Modeling of Object and Action for Video-Language Pre-training
Although large-scale video-language pre-training models, which usually b...
research
∙
08/03/2022
Effidit: Your AI Writing Assistant
In this technical report, we introduce Effidit (Efficient and Intelligen...
research
∙
05/12/2022
One Model, Multiple Modalities: A Sparsely Activated Approach for Text, Sound, Image, Video and Code
People perceive the world with multiple senses (e.g., through hearing so...
research
∙
04/26/2022
SkillNet-NLG: General-Purpose Natural Language Generation with a Sparsely Activated Approach
We present SkillNet-NLG, a sparsely activated approach that handles many...
research
∙
04/26/2022
Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors
Chinese BERT models achieve remarkable progress in dealing with grammati...
research
∙
03/12/2022
MarkBERT: Marking Word Boundaries Improves Chinese BERT
We present a Chinese BERT model dubbed MarkBERT that uses word informati...
research
∙
03/07/2022
One Model, Multiple Tasks: Pathways for Natural Language Understanding
This paper presents a Pathways approach to handle many tasks at once. Ou...
research
∙
03/01/2022
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction
Whole word masking (WWM), which masks all subwords corresponding to a wo...
research
∙
03/01/2022
Exploring and Adapting Chinese GPT to Pinyin Input Method
While GPT has become the de-facto method for text generation tasks, its ...
research
∙
02/24/2022
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words
The standard BERT adopts subword-based tokenization, which may break a w...
research
∙
04/05/2021
WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach
Producing the embedding of a sentence in an unsupervised way is valuable...
research
∙
12/28/2020
Syntax-Enhanced Pre-trained Model
We study the problem of leveraging the syntactic structure of text to en...
research
∙
10/15/2020
Neural Deepfake Detection with Factual Structure of Text
Deepfake detection, the task of automatically discriminating machine-gen...
research
∙
09/22/2020
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
Evaluation metrics play a vital role in the growth of an area as it defi...
research
∙
09/17/2020
GraphCodeBERT: Pre-training Code Representations with Data Flow
Pre-trained models for programming language have achieved dramatic empir...
research
∙
06/15/2020
Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder
Generating inferential texts about an event in different perspectives re...
research
∙
04/29/2020
Leveraging Declarative Knowledge in Text and First-Order Logic for Fine-Grained Propaganda Detection
We study the detection of propagandistic text fragments in news articles...
research
∙
04/28/2020
LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network
Verifying the correctness of a textual statement requires not only seman...
research
∙
04/25/2020
A Heterogeneous Graph with Factual, Temporal and Logical Knowledge for Question Answering Over Dynamic Contexts
We study question answering over a dynamic textual environment. Although...
research
∙
04/12/2020
Pre-training Text Representations as Meta Learning
Pre-training text representations has recently been shown to significant...
research
∙
04/07/2020
Inferential Text Generation with Multiple Knowledge Sources and Meta-Learning
We study the problem of generating inferential texts of events for a var...
research
∙
02/19/2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
We present CodeBERT, a bimodal pre-trained model for programming languag...
research
∙
02/05/2020
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
We study the problem of injecting knowledge into large pre-trained model...
research
∙
10/11/2019
Multi-Task Learning for Conversational Question Answering over a Large-Scale Knowledge Base
We consider the problem of conversational question answering over a larg...
research
∙
09/12/2019
Neural Semantic Parsing in Low-Resource Settings with Back-Translation and Meta-Learning
Neural semantic parsing has achieved impressive results in recent years,...
research
∙
09/09/2019
Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering
Commonsense question answering aims to answer questions which require ba...
research
∙
09/09/2019
Reasoning Over Semantic-Level Graph for Fact Checking
We study fact-checking in this paper, which aims to verify a textual cla...
research
∙
06/17/2019
Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing
In this paper, we present an approach to incorporate retrieved datapoint...
research
∙
05/24/2019
Deep Reason: A Strong Baseline for Real-World Visual Reasoning
This paper presents a strong baseline for real-world visual reasoning (G...
research
∙
09/12/2018
Knowledge-Aware Conversational Semantic Parsing Over Web Tables
Conversational semantic parsing over tables requires knowledge acquiring...
research
∙
09/12/2018
Knowledge Based Machine Reading Comprehension
Machine reading comprehension (MRC) requires reasoning about both the kn...
research
∙
09/05/2018
Improving Question Answering by Commonsense-Based Pre-Training
Although neural network approaches achieve remarkable success on a varie...
research
∙
08/20/2018
Question Generation from SQL Queries Improves Neural Semantic Parsing
We study how to learn a semantic parser of state-of-the-art accuracy wit...
research
∙
05/29/2018
Table-to-Text: Describing Table Region with Natural Language
In this paper, we present a generative model to generate a natural langu...
research
∙
04/23/2018
Semantic Parsing with Syntax- and Table-Aware SQL Generation
We present a generative model to map natural language questions into SQL...
research
∙
01/23/2018
Assertion-based QA with Question-Aware Open Information Extraction
We present assertion based question answering (ABQA), an open domain que...
research
∙
06/08/2017
Content-Based Table Retrieval for Web Queries
Understanding the connections between unstructured text and semi-structu...
research
∙
06/07/2017
Question Answering and Question Generation as Dual Tasks
We study the problem of joint question answering (QA) and question gener...
research
∙
05/28/2016
Aspect Level Sentiment Classification with Deep Memory Network
We introduce a deep memory network for aspect level sentiment classifica...
research
∙
12/18/2015
A Planning based Framework for Essay Generation
Generating an article automatically with computer program is a challengi...
research
∙
12/03/2015