b'Maosong Sun'

research

∙ 07/13/2022

Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation

The past several years have witnessed Variational Auto-Encoder's superio...

Jinyi Hu, et al. ∙

research

∙ 06/19/2022

A Unified Understanding of Deep NLP Models for Text Classification

The rapid development of deep natural language processing (NLP) models f...

Zhen Li, et al. ∙

research

∙ 06/17/2022

A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks

Textual backdoor attacks are a kind of practical threat to NLP systems. ...

Ganqu Cui, et al. ∙

research

∙ 06/15/2022

Sparse Structure Search for Parameter-Efficient Tuning

Adapting large pre-trained models (PTMs) through fine-tuning imposes pro...

Shengding Hu, et al. ∙

research

∙ 05/23/2022

PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models

Vision-language pre-training (VLP) has shown impressive performance on a...

Yuan Yao, et al. ∙

research

∙ 05/23/2022

Prompt Tuning for Discriminative Pre-trained Language Models

Recent works have shown promising results of prompt tuning in stimulatin...

Yuan Yao, et al. ∙

research

∙ 05/12/2022

Sampling with Attribute-Related Information for Controlling Language Models

The dominant approaches for controlling language models are based on fin...

Shangda Wu, et al. ∙

research

∙ 03/22/2022

Fine-Grained Scene Graph Generation with Data Transfer

Scene graph generation (SGG) aims to extract (subject, predicate, object...

Ao Zhang, et al. ∙

research

∙ 03/16/2022

LEVEN: A Large-Scale Chinese Legal Event Detection Dataset

Recognizing facts is the most fundamental step in making judgments, henc...

Feng Yao, et al. ∙

research

∙ 03/14/2022

Sememe Prediction for BabelNet Synsets using Multilingual and Multimodal Information

In linguistics, a sememe is defined as the minimum semantic unit of lang...

Fanchao Qi, et al. ∙

research

∙ 03/12/2022

ELLE: Efficient Lifelong Pre-training for Emerging Data

Current pre-trained language models (PLM) are typically trained with sta...

Yujia Qin, et al. ∙

research

∙ 02/27/2022

A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models

Pre-trained language models (PLMs) cannot well recall rich factual knowl...

Deming Ye, et al. ∙

research

∙ 02/26/2022

QuoteR: A Benchmark of Quote Recommendation for Writing

It is very common to use quotations (quotes) to make our writings more e...

Fanchao Qi, et al. ∙

research

∙ 02/17/2022

Chord-Conditioned Melody Choralization with Controllable Harmonicity and Polyphonicity

Melody choralization, i.e. generating a four-part chorale based on a use...

Shangda Wu, et al. ∙

research

∙ 12/30/2021

YACLC: A Chinese Learner Corpus with Multidimensional Annotation

Learner corpus collects language data produced by L2 learners, that is s...

Yingying Wang, et al. ∙

research

∙ 12/21/2021

Melody Harmonization with Controllable Harmonic Rhythm

Melody harmonization, namely generating a chord progression for a user-g...

Shangda Wu, et al. ∙

research

∙ 11/12/2021

On Transferability of Prompt Tuning for Natural Language Understanding

Prompt tuning (PT) is a promising parameter-efficient method to utilize ...

Yusheng Su, et al. ∙

research

∙ 11/03/2021

OpenPrompt: An Open-source Framework for Prompt-learning

Prompt-learning has become a new paradigm in modern natural language pro...

Ning Ding, et al. ∙

research

∙ 10/15/2021

Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks

Backdoor attacks are a kind of emergent security threat in deep learning...

Yangyi Chen, et al. ∙

research

∙ 10/15/2021

Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning

How can pre-trained language models (PLMs) learn universal representatio...

Yujia Qin, et al. ∙

research

∙ 10/14/2021

Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer

Adversarial attacks and backdoor attacks are two common security threats...

Fanchao Qi, et al. ∙

research

∙ 10/05/2021

MoEfication: Conditional Computation of Transformer Models for Efficient Inference

Transformer-based pre-trained language models can achieve superior perfo...

Zhengyan Zhang, et al. ∙

research

∙ 09/24/2021

CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models

Pre-Trained Vision-Language Models (VL-PTMs) have shown promising capabi...

Yuan Yao, et al. ∙

research

∙ 09/13/2021

Pack Together: Entity and Relation Extraction with Levitated Marker

Named Entity Recognition (NER) and Relation Extraction (RE) are the core...

Deming Ye, et al. ∙

research

∙ 08/27/2021

Lingxi: A Diversity-aware Chinese Modern Poetry Generation System

Poetry generation has been a difficult task in natural language processi...

Xinran Zhang, et al. ∙

research

∙ 08/04/2021

Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification

Tuning pre-trained language models (PLMs) with task-specific prompts has...

Shengding Hu, et al. ∙

research

∙ 06/27/2021

From Symbols to Embeddings: A Tale of Two Representations in Computational Social Science

Computational Social Science (CSS), aiming at utilizing computational me...

Huimin Chen, et al. ∙

research

∙ 06/11/2021

Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution

Recent studies show that neural natural language processing (NLP) models...

Fanchao Qi, et al. ∙

research

∙ 06/03/2021

CCPM: A Chinese Classical Poetry Matching Dataset

Poetry is one of the most important art forms of human languages. Recent...

Wenhao Li, et al. ∙

research

∙ 06/01/2021

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining

Conventional tokenization methods for Chinese pretrained language models...

Chenglei Si, et al. ∙

research

∙ 05/31/2021

Fully Hyperbolic Neural Networks

Hyperbolic neural networks have shown great potential for modeling compl...

Weize Chen, et al. ∙

research

∙ 05/28/2021

Knowledge Inheritance for Pre-trained Language Models

Recent explorations of large-scale pre-trained language models (PLMs) su...

Yujia Qin, et al. ∙

research

∙ 05/26/2021

Automatic Construction of Sememe Knowledge Bases via Dictionaries

A sememe is defined as the minimum semantic unit in linguistics. Sememe ...

Fanchao Qi, et al. ∙

research

∙ 05/26/2021

Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger

Backdoor attacks are a kind of insidious security threat against machine...

Fanchao Qi, et al. ∙

research

∙ 05/25/2021

TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference

Existing pre-trained language models (PLMs) are often computationally ex...

Deming Ye, et al. ∙

research

∙ 05/24/2021

PTR: Prompt Tuning with Rules for Text Classification

Fine-tuned pre-trained language models (PLMs) have achieved awesome perf...

Xu Han, et al. ∙

research

∙ 05/20/2021

Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction

Distantly supervised (DS) relation extraction (RE) has attracted much at...

Tianyu Gao, et al. ∙

research

∙ 05/10/2021

Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction

Grammatical Error Correction (GEC) aims to correct writing errors and he...

Zhenghao Liu, et al. ∙

research

∙ 05/09/2021

Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

Legal artificial intelligence (LegalAI) aims to benefit legal systems wi...

Chaojun Xiao, et al. ∙

research

∙ 03/29/2021

Visual Distant Supervision for Scene Graph Generation

Scene graph generation aims to identify objects and their relations in i...

Yuan Yao, et al. ∙

research

∙ 03/25/2021

Equality before the Law: Legal Judgment Consistency Analysis for Fairness

In a legal system, judgment consistency is regarded as one of the most i...

Yuzhong Wang, et al. ∙

research

∙ 03/13/2021

Embedding Calibration for Music Semantic Similarity using Auto-regressive Transformer

One of the advantages of using natural language processing (NLP) technol...

Xinran Zhang, et al. ∙

research

∙ 03/13/2021

Improving Diversity of Neural Text Generation via Inverse Probability Weighting

The neural network based text generation suffers from the text degenerat...

Xinran Zhang, et al. ∙

research

∙ 02/22/2021

UPRec: User-Aware Pre-training for Recommender Systems

Existing sequential recommendation methods rely on large amounts of trai...

Chaojun Xiao, et al. ∙

research

∙ 02/07/2021

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models

Fine-tuning pre-trained language models (PLMs) has demonstrated its effe...

Yusheng Su, et al. ∙

research

∙ 02/07/2021

Representation Learning for Natural Language Processing

This book aims to review and present the recent advances of distributed ...

Zhiyuan Liu, et al. ∙

research

∙ 01/18/2021

Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks

Due to the success of pre-trained models (PTMs), people usually fine-tun...

Zhengyan Zhang, et al. ∙

research

∙ 12/30/2020

ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

Pre-trained Language Models (PLMs) have shown strong performance in vari...

Yujia Qin, et al. ∙

research

∙ 12/13/2020

Mask-Align: Self-Supervised Neural Word Alignment

Neural word alignment methods have received increasing attention recentl...

Chi Chen, et al. ∙

research

∙ 12/01/2020

CPM: A Large-scale Generative Chinese Pre-trained Language Model

Pre-trained Language Models (PLMs) have proven to be beneficial for vari...

Zhengyan Zhang, et al. ∙

Maosong Sun

Featured Co-authors