Maosong Sun

is this you? claim profile

∙ 0 followers
Tsinghua University

Professor in Department of Computer Science and Technology at Tsinghua University

From Symbols to Embeddings: A Tale of Two Representations in Computational Social Science

Computational Social Science (CSS), aiming at utilizing computational me...
06/27/2021 ∙ by Huimin Chen, et al. ∙ 0 ∙ share

read it
Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution

Recent studies show that neural natural language processing (NLP) models...
06/11/2021 ∙ by Fanchao Qi, et al. ∙ 0 ∙ share

read it
CCPM: A Chinese Classical Poetry Matching Dataset

Poetry is one of the most important art forms of human languages. Recent...
06/03/2021 ∙ by Wenhao Li, et al. ∙ 0 ∙ share

read it
SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining

Conventional tokenization methods for Chinese pretrained language models...
06/01/2021 ∙ by Chenglei Si, et al. ∙ 0 ∙ share

read it
Fully Hyperbolic Neural Networks

Hyperbolic neural networks have shown great potential for modeling compl...
05/31/2021 ∙ by Weize Chen, et al. ∙ 0 ∙ share

read it
Knowledge Inheritance for Pre-trained Language Models

Recent explorations of large-scale pre-trained language models (PLMs) su...
05/28/2021 ∙ by Yujia Qin, et al. ∙ 8 ∙ share

read it
Automatic Construction of Sememe Knowledge Bases via Dictionaries

A sememe is defined as the minimum semantic unit in linguistics. Sememe ...
05/26/2021 ∙ by Fanchao Qi, et al. ∙ 0 ∙ share

read it
Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger

Backdoor attacks are a kind of insidious security threat against machine...
05/26/2021 ∙ by Fanchao Qi, et al. ∙ 0 ∙ share

read it
TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference

Existing pre-trained language models (PLMs) are often computationally ex...
05/25/2021 ∙ by Deming Ye, et al. ∙ 0 ∙ share

read it
PTR: Prompt Tuning with Rules for Text Classification

Fine-tuned pre-trained language models (PLMs) have achieved awesome perf...
05/24/2021 ∙ by Xu Han, et al. ∙ 0 ∙ share

read it
Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction

Distantly supervised (DS) relation extraction (RE) has attracted much at...
05/20/2021 ∙ by Tianyu Gao, et al. ∙ 16 ∙ share

read it
Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction

Grammatical Error Correction (GEC) aims to correct writing errors and he...
05/10/2021 ∙ by Zhenghao Liu, et al. ∙ 0 ∙ share

read it
Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

Legal artificial intelligence (LegalAI) aims to benefit legal systems wi...
05/09/2021 ∙ by Chaojun Xiao, et al. ∙ 3 ∙ share

read it
Visual Distant Supervision for Scene Graph Generation

Scene graph generation aims to identify objects and their relations in i...
03/29/2021 ∙ by Yuan Yao, et al. ∙ 0 ∙ share

read it
Equality before the Law: Legal Judgment Consistency Analysis for Fairness

In a legal system, judgment consistency is regarded as one of the most i...
03/25/2021 ∙ by Yuzhong Wang, et al. ∙ 0 ∙ share

read it
Embedding Calibration for Music Semantic Similarity using Auto-regressive Transformer

One of the advantages of using natural language processing (NLP) technol...
03/13/2021 ∙ by Xinran Zhang, et al. ∙ 0 ∙ share

read it
Improving Diversity of Neural Text Generation via Inverse Probability Weighting

The neural network based text generation suffers from the text degenerat...
03/13/2021 ∙ by Xinran Zhang, et al. ∙ 0 ∙ share

read it
UPRec: User-Aware Pre-training for Recommender Systems

Existing sequential recommendation methods rely on large amounts of trai...
02/22/2021 ∙ by Chaojun Xiao, et al. ∙ 0 ∙ share

read it
CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models

Fine-tuning pre-trained language models (PLMs) has demonstrated its effe...
02/07/2021 ∙ by YuSheng Su, et al. ∙ 0 ∙ share

read it
Representation Learning for Natural Language Processing

This book aims to review and present the recent advances of distributed ...
02/07/2021 ∙ by Zhiyuan Liu, et al. ∙ 0 ∙ share

read it
Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks

Due to the success of pre-trained models (PTMs), people usually fine-tun...
01/18/2021 ∙ by Zhengyan Zhang, et al. ∙ 0 ∙ share

read it
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

Pre-trained Language Models (PLMs) have shown strong performance in vari...
12/30/2020 ∙ by Yujia Qin, et al. ∙ 17 ∙ share

read it
Mask-Align: Self-Supervised Neural Word Alignment

Neural word alignment methods have received increasing attention recentl...
12/13/2020 ∙ by Chi Chen, et al. ∙ 0 ∙ share

read it
CPM: A Large-scale Generative Chinese Pre-trained Language Model

Pre-trained Language Models (PLMs) have proven to be beneficial for vari...
12/01/2020 ∙ by Zhengyan Zhang, et al. ∙ 4 ∙ share

read it
ONION: A Simple and Effective Defense Against Textual Backdoor Attacks

Backdoor attacks, which are a kind of emergent training-time threat to d...
11/20/2020 ∙ by Fanchao Qi, et al. ∙ 0 ∙ share

read it
Denoising Relation Extraction from Document-level Distant Supervision

Distant supervision (DS) has been widely used to generate auto-labeled d...
11/08/2020 ∙ by Chaojun Xiao, et al. ∙ 0 ∙ share

read it
PiRhDy: Learning Pitch-, Rhythm-, and Dynamics-aware Embeddings for Symbolic Music

Definitive embeddings remain a fundamental challenge of computational mu...
10/16/2020 ∙ by Hongru Liang, et al. ∙ 0 ∙ share

read it
Learning from Context or Names? An Empirical Study on Neural Relation Extraction

Neural models have achieved remarkable success on relation extraction (R...
10/05/2020 ∙ by Hao Peng, et al. ∙ 0 ∙ share

read it
Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models

Several recent efforts have been devoted to enhancing pre-trained langua...
09/29/2020 ∙ by YuSheng Su, et al. ∙ 0 ∙ share

read it
Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect

Recommender systems aim to provide item recommendations for users, and a...
09/19/2020 ∙ by Zheni Zeng, et al. ∙ 0 ∙ share

read it
Learning to Attack: Towards Textual Adversarial Attacking in Real-world Situations

Adversarial attacking aims to fool deep neural networks with adversarial...
09/19/2020 ∙ by Yuan Zang, et al. ∙ 0 ∙ share

read it
OpenAttack: An Open-source Textual Adversarial Attack Toolkit

Textual adversarial attacking has received wide and increasing attention...
09/19/2020 ∙ by Guoyang Zeng, et al. ∙ 0 ∙ share

read it
Country Image in COVID-19 Pandemic: A Case Study of China

Country image has a profound influence on international relations and ec...
09/12/2020 ∙ by Huimin Chen, et al. ∙ 0 ∙ share

read it
Modeling Voting for System Combination in Machine Translation

System combination is an important technique for combining the hypothese...
07/14/2020 ∙ by Xuancheng Huang, et al. ∙ 0 ∙ share

read it
KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion

Knowledge graphs (KGs) contains an instance-level entity graph and an on...
04/28/2020 ∙ by Jie Zhou, et al. ∙ 0 ∙ share

read it
How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence

Legal Artificial Intelligence (LegalAI) focuses on applying the technolo...
04/25/2020 ∙ by Haoxi Zhong, et al. ∙ 0 ∙ share

read it
Train No Evil: Selective Masking for Task-guided Pre-training

Recently, pre-trained language models mostly follow the pre-training-the...
04/21/2020 ∙ by Yuxian Gu, et al. ∙ 0 ∙ share

read it
Coreferential Reasoning Learning for Language Representation

Language representation models such as BERT could effectively capture co...
04/15/2020 ∙ by Deming Ye, et al. ∙ 0 ∙ share

read it
More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction

Relational facts are an important component of human knowledge, which ar...
04/07/2020 ∙ by Xu Han, et al. ∙ 0 ∙ share

read it
Generating Major Types of Chinese Classical Poetry in a Uniformed Framework

Poetry generation is an interesting research topic in the field of text ...
03/13/2020 ∙ by Jinyi Hu, et al. ∙ 0 ∙ share

read it
MixPoet: Diverse Poetry Generation via Learning Controllable Mixed Latent Space

As an essential step towards computer creativity, automatic poetry gener...
03/13/2020 ∙ by Xiaoyuan Yi, et al. ∙ 0 ∙ share

read it
Lexical Sememe Prediction using Dictionary Definitions by Capturing Local Semantic Correspondence

Sememes, defined as the minimum semantic units of human languages in lin...
01/16/2020 ∙ by Jiaju Du, et al. ∙ 0 ∙ share

read it
Towards Building a Multilingual Sememe Knowledge Base: Predicting Sememes for BabelNet Synsets

A sememe is defined as the minimum semantic unit of human languages. Sem...
12/04/2019 ∙ by Fanchao Qi, et al. ∙ 0 ∙ share

read it
JEC-QA: A Legal-Domain Question Answering Dataset

We present JEC-QA, the largest question answering dataset in the legal d...
11/27/2019 ∙ by Haoxi Zhong, et al. ∙ 0 ∙ share

read it
Neural Machine Translation with Explicit Phrase Alignment

While neural machine translation (NMT) has achieved state-of-the-art tra...
11/26/2019 ∙ by Jiacheng Zhang, et al. ∙ 0 ∙ share

read it
CAIL2019-SCM: A Dataset of Similar Case Matching in Legal Domain

In this paper, we introduce CAIL2019-SCM, Chinese AI and Law 2019 Simila...
11/20/2019 ∙ by Chaojun Xiao, et al. ∙ 0 ∙ share

read it
Learning to Copy for Automatic Post-Editing

Automatic post-editing (APE), which aims to correct errors in the output...
11/09/2019 ∙ by Xuancheng Huang, et al. ∙ 0 ∙ share

read it
Multi-Paragraph Reasoning with Knowledge-enhanced Graph Neural Network

Multi-paragraph reasoning is indispensable for open-domain question answ...
11/06/2019 ∙ by Deming Ye, et al. ∙ 0 ∙ share

read it
Adversarial Language Games for Advanced Natural Language Intelligence

While adversarial games have been well studied in various board games an...
11/05/2019 ∙ by Yuan Yao, et al. ∙ 0 ∙ share

read it
Kernel Graph Attention Network for Fact Verification

This paper presents Kernel Graph Attention Network (KGAT), which conduct...
10/22/2019 ∙ by Zhenghao Liu, et al. ∙ 0 ∙ share

read it

Maosong Sun

Featured Co-authors