Xuanjing Huang

research

∙ 12/21/2022

Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?

Multilingual BERT (mBERT) has demonstrated considerable cross-lingual sy...

Ningyu Xu, et al. ∙

research

∙ 12/19/2022

Rethinking Label Smoothing on Multi-hop Question Answering

Label smoothing is a regularization technique widely used in supervised ...

Zhangyue Yin, et al. ∙

research

∙ 11/14/2022

Efficient Adversarial Training with Robust Early-Bird Tickets

Adversarial training is one of the most powerful methods to improve the ...

Zhiheng Xi, et al. ∙

research

∙ 11/06/2022

Robust Lottery Tickets for Pre-trained Language Models

Recent works on Lottery Ticket Hypothesis have shown that pre-trained la...

Rui Zheng, et al. ∙

research

∙ 10/14/2022

Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding

Dataset bias has attracted increasing attention recently for its detrime...

Songyang Gao, et al. ∙

research

∙ 10/10/2022

Learning "O" Helps for Learning More: Handling the Concealed Entity Problem for Class-incremental NER

As the categories of named entities rapidly increase in real-world appli...

Ruotian Ma, et al. ∙

research

∙ 09/29/2022

COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization

Traditional training paradigms for extractive and abstractive summarizat...

Chenxin An, et al. ∙

research

∙ 08/27/2022

A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck

Event argument extraction (EAE) aims to extract arguments with given rol...

Jie Zhou, et al. ∙

research

∙ 08/22/2022

Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering

Multi-hop reasoning requires aggregating multiple documents to answer a ...

Siyuan Wang, et al. ∙

research

∙ 08/19/2022

Causal Intervention Improves Implicit Sentiment Analysis

Despite having achieved great success for sentiment analysis, existing n...

Siyin Wang, et al. ∙

research

∙ 06/11/2022

A Unified Continuous Learning Framework for Multi-modal Knowledge Discovery and Pre-training

Multi-modal pre-training and knowledge discovery are two important resea...

Zhihao Fan, et al. ∙

research

∙ 05/29/2022

CoNT: Contrastive Neural Text Generation

Recently, contrastive learning attracts increasing interests in neural t...

Chenxin An, et al. ∙

research

∙ 05/27/2022

What Dense Graph Do You Need for Self-Attention?

Transformers have made progress in miscellaneous tasks, but suffer from ...

Yuxing Wang, et al. ∙

research

∙ 04/19/2022

A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasets

In recent years, interest has arisen in using machine learning to improv...

Wei Chen, et al. ∙

research

∙ 04/09/2022

MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective

NER model has achieved promising performance on standard NER benchmarks....

Xiao Wang, et al. ∙

research

∙ 02/16/2022

Decorrelate Irrelevant, Purify Relevant: Overcome Textual Spurious Correlations from a Feature Perspective

Natural language understanding (NLU) models tend to rely on spurious cor...

Shihan Dou, et al. ∙

research

∙ 01/29/2022

MVPTR: Multi-Stage Vision-Language Pre-Training via Multi-Level Semantic Alignment

In this paper, we propose a Multi-stage Vision-language Pre-TRaining (MV...

Zejun Li, et al. ∙

research

∙ 10/14/2021

Plug-Tagger: A Pluggable Sequence Labeling Framework Using Language Models

Plug-and-play functionality allows deep learning models to adapt well to...

Xin Zhou, et al. ∙

research

∙ 10/13/2021

Towards Efficient NLP: A Standard Evaluation and A Strong Baseline

Supersized pre-trained language models have pushed the accuracy of vario...

Xiangyang Liu, et al. ∙

research

∙ 10/06/2021

KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier

Pre-trained models are widely used in fine-tuning downstream tasks with ...

Linyang Li, et al. ∙

research

∙ 09/28/2021

Template-free Prompt Tuning for Few-shot NER

Prompt-based methods have been successfully applied in sentence-level fe...

Ruotian Ma, et al. ∙

research

∙ 09/26/2021

Paradigm Shift in Natural Language Processing

In the era of deep learning, modeling for most NLP tasks has converged t...

Tianxiang Sun, et al. ∙

research

∙ 09/12/2021

Constructing Phrase-level Semantic Labels to Form Multi-Grained Supervision for Image-Text Retrieval

Existing research for image text retrieval mainly relies on sentence-lev...

Zhihao Fan, et al. ∙

research

∙ 09/10/2021

Learning to Teach with Student Feedback

Knowledge distillation (KD) has gained much attention due to its effecti...

Yitao Liu, et al. ∙

research

∙ 08/19/2021

Fine-Grained Element Identification in Complaint Text of Internet Fraud

Existing system dealing with online complaint provides a final decision ...

Tong Liu, et al. ∙

research

∙ 06/22/2021

SENT: Sentence-level Distant Relation Extraction via Negative Training

Distant supervision for relation extraction provides uniform bag labels ...

Ruotian Ma, et al. ∙

research

∙ 06/21/2021

TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning

Existing research for image captioning usually represents an image using...

Zhihao Fan, et al. ∙

research

∙ 06/01/2021

SpanNER: Named Entity Re-/Recognition as Span Prediction

Recent years have seen the paradigm shift of Named Entity Recognition (N...

Jinlan Fu, et al. ∙

research

∙ 05/31/2021

Exploration and Exploitation: Two Ways to Improve Chinese Spelling Correction Models

A sequence-to-sequence learning with neural networks has empirically pro...

Chong Li, et al. ∙

research

∙ 05/28/2021

Accelerating BERT Inference for Sequence Labeling via Early-Exit

Both performance and efficiency are crucial factors for sequence labelin...

Xiaonan Li, et al. ∙

research

∙ 05/28/2021

Early Exiting with Ensemble Internal Classifiers

As a simple technique to accelerate inference of large-scale pre-trained...

Tianxiang Sun, et al. ∙

research

∙ 05/08/2021

Certified Robustness to Text Adversarial Attacks by Randomized [MASK]

Recently, few certified defense methods have been developed to provably ...

Jiehang Zeng, et al. ∙

research

∙ 04/17/2021

Who Responded to Whom: The Joint Effects of Latent Topics and Discourse in Conversation Structure

Numerous online conversations are produced on a daily basis, resulting i...

Lu Ji, et al. ∙

research

∙ 04/09/2021

Larger-Context Tagging: When and Why Does It Work?

The development of neural networks and pretraining techniques has spawne...

Jinlan Fu, et al. ∙

research

∙ 04/07/2021

Enhancing Scientific Papers Summarization with Citation Graph

Previous work for text summarization in scientific domain mainly focused...

Chenxin An, et al. ∙

research

∙ 03/25/2021

Mask Attention Networks: Rethinking and Strengthen Transformer

Transformer is an attention-based neural network, which consists of two ...

Zhihao Fan, et al. ∙

research

∙ 03/22/2021

Alleviate Exposure Bias in Sequence Prediction with Recurrent Neural Networks

A popular strategy to train recurrent neural networks (RNNs), known as “...

Liping Yuan, et al. ∙

research

∙ 03/21/2021

TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing

Various robustness evaluation methodologies from different perspectives ...

Tao Gui, et al. ∙

research

∙ 03/21/2021

An Unsupervised Sampling Approach for Image-Sentence Matching Using Document-Level Structural Information

In this paper, we focus on the problem of unsupervised image-sentence ma...

Zejun Li, et al. ∙

research

∙ 12/29/2020

Generating Adversarial Examples in Chinese Texts Using Sentence-Pieces

Adversarial attacks in texts are mostly substitution-based methods that ...

Linyang Li, et al. ∙

research

∙ 12/19/2020

Uncertainty-Aware Label Refinement for Sequence Labeling

Conditional random fields (CRF) for label decoding has become ubiquitous...

Tao Gui, et al. ∙

research

∙ 12/14/2020

Topic-Oriented Spoken Dialogue Summarization for Customer Service with Saliency-Aware Topic Modeling

In a customer service system, dialogue summarization can boost service e...

Yicheng Zou, et al. ∙

research

∙ 12/14/2020

Unsupervised Summarization for Chat Logs with Topic-Oriented Ranking and Context-Aware Auto-Encoders

Automatic chat summarization can help people quickly grasp important inf...

Yicheng Zou, et al. ∙

research

∙ 12/12/2020

SenSeNet: Neural Keyphrase Generation with Document Structure

Keyphrase Generation (KG) is the task of generating central topics from ...

Yichao Luo, et al. ∙

research

∙ 12/01/2020

An Enhanced Knowledge Injection Model for Commonsense Generation

Commonsense generation aims at generating plausible everyday scenario de...

Zhihao Fan, et al. ∙

research

∙ 11/17/2020

Generating universal language adversarial examples by understanding and enhancing the transferability across neural models

Deep neural network models are vulnerable to adversarial attacks. In man...

Liping Yuan, et al. ∙

research

∙ 11/16/2020

Text Information Aggregation with Centrality Attention

A lot of natural language processing problems need to encode the text se...

Jingjing Gong, et al. ∙

research

∙ 11/13/2020

RethinkCWS: Is Chinese Word Segmentation a Solved Task?

The performance of the Chinese Word Segmentation (CWS) systems has gradu...

Jinlan Fu, et al. ∙

research

∙ 10/11/2020

CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems

Neural network-based models augmented with unsupervised pre-trained know...

Yiran Chen, et al. ∙

research

∙ 10/01/2020

CoLAKE: Contextualized Language and Knowledge Embedding

With the emerging branch of incorporating factual knowledge into pre-tra...

Tianxiang Sun, et al. ∙

Xuanjing Huang

Featured Co-authors