b'Xipeng Qiu'

research

∙ 08/31/2023

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models

Current speech large language models build upon discrete speech represen...

0 Xin Zhang, et al. ∙

research

∙ 08/05/2023

EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Education

EduChat (https://www.educhat.top/) is a large-scale language model (LLM)...

0 Yuhao Dan, et al. ∙

research

∙ 08/03/2023

Does Correction Remain A Problem For Large Language Models?

As large language models, such as GPT, continue to advance the capabilit...

0 Xiaowu Zhang, et al. ∙

research

∙ 06/19/2023

Distributed Marker Representation for Ambiguous Discourse Markers and Entangled Relations

Discourse analysis is an important task because it models intrinsic sema...

0 Dongyu Ru, et al. ∙

research

∙ 06/16/2023

Full Parameter Fine-tuning for Large Language Models with Limited Resources

Large Language Models (LLMs) have revolutionized Natural Language Proces...

0 Kai Lv, et al. ∙

research

∙ 06/16/2023

From Hypergraph Energy Functions to Hypergraph Neural Networks

Hypergraphs are a powerful abstraction for representing higher-order int...

0 Yuxin Wang, et al. ∙

research

∙ 05/30/2023

An AMR-based Link Prediction Approach for Document-level Event Argument Extraction

Recent works have introduced Abstract Meaning Representation (AMR) for D...

0 Yuqing Yang, et al. ∙

research

∙ 05/29/2023

Do Large Language Models Know What They Don't Know?

Large language models (LLMs) have a wealth of knowledge that allows them...

0 Zhangyue Yin, et al. ∙

research

∙ 05/25/2023

Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System

Dialogue data in real scenarios tend to be sparsely available, rendering...

0 Shimin Li, et al. ∙

research

∙ 05/21/2023

Evaluating the Performance of Large Language Models on GAOKAO Benchmark

Large language models have demonstrated remarkable performance across va...

0 Xiaotian Zhang, et al. ∙

research

∙ 05/20/2023

PromptNER: A Prompting Method for Few-shot Named Entity Recognition via k Nearest Neighbor Search

Few-shot Named Entity Recognition (NER) is a task aiming to identify nam...

0 Mozhi Zhang, et al. ∙

research

∙ 05/18/2023

SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities

Multi-modal large language models are regarded as a crucial step towards...

0 Dong Zhang, et al. ∙

research

∙ 05/09/2023

MoT: Pre-thinking and Recalling Enable ChatGPT to Self-Improve with Memory-of-Thoughts

Large Language Models have shown impressive abilities on various tasks. ...

0 Xiaonan Li, et al. ∙

research

∙ 05/07/2023

Unified Demonstration Retriever for In-Context Learning

In-context learning is a new learning paradigm where a language model co...

0 Xiaonan Li, et al. ∙

research

∙ 02/27/2023

Finding Supporting Examples for In-Context Learning

In-context learning is a new learning paradigm where a language model ob...

0 Xiaonan Li, et al. ∙

research

∙ 12/19/2022

Rethinking Label Smoothing on Multi-hop Question Answering

Label smoothing is a regularization technique widely used in supervised ...

0 Zhangyue Yin, et al. ∙

research

∙ 12/14/2022

Mitigating Negative Style Transfer in Hybrid Dialogue System

As the functionality of dialogue systems evolves, hybrid dialogue system...

0 Shimin Li, et al. ∙

research

∙ 12/08/2022

Investigating Glyph Phonetic Information for Chinese Spell Checking: What Works and What's Next

While pre-trained Chinese language models have demonstrated impressive p...

0 Xiaotian Zhang, et al. ∙

research

∙ 11/23/2022

Word-Level Representation From Bytes For Language Modeling

Modern language models mostly take sub-words as input, a design that bal...

0 Chu-Tak Lee, et al. ∙

research

∙ 10/31/2022

SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking

Due to the ambiguity of homophones, Chinese Spell Checking (CSC) has wid...

0 Xiaotian Zhang, et al. ∙

research

∙ 10/31/2022

RLET: A Reinforcement Learning Based Approach for Explainable QA with Entailment Trees

Interpreting the reasoning process from questions to answers poses a cha...

0 Tengxiao Liu, et al. ∙

research

∙ 10/28/2022

DORE: Document Ordered Relation Extraction based on Generative Framework

In recent years, there is a surge of generation-based information extrac...

0 Qipeng Guo, et al. ∙

research

∙ 10/26/2022

Is MultiWOZ a Solved Task? An Interactive TOD Evaluation Framework with User Simulator

Task-Oriented Dialogue (TOD) systems are drawing more and more attention...

0 Qinyuan Cheng, et al. ∙

research

∙ 10/21/2022

Discovering New Intents Using Latent Variables

Discovering new intents is of great significance to establishing Bootstr...

0 Yunhua Zhou, et al. ∙

research

∙ 10/18/2022

Soft-Labeled Contrastive Pre-training for Function-level Code Representation

Code contrastive pre-training has recently achieved significant progress...

0 Xiaonan Li, et al. ∙

research

∙ 10/13/2022

An Open-World Lottery Ticket for Out-of-Domain Intent Classification

Most existing methods of Out-of-Domain (OOD) intent classification, whic...

0 Yunhua Zhou, et al. ∙

research

∙ 09/29/2022

COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization

Traditional training paradigms for extractive and abstractive summarizat...

0 Chenxin An, et al. ∙

research

∙ 09/23/2022

A Unified Generative Framework based on Prompt Learning for Various Information Extraction Tasks

Prompt learning is an effective paradigm that bridges gaps between the p...

0 Zhigang Kan, et al. ∙

research

∙ 08/19/2022

Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding

Generalized text representations are the foundation of many natural lang...

7 Zhaoye Fei, et al. ∙

research

∙ 08/09/2022

An Embarrassingly Easy but Strong Baseline for Nested Named Entity Recognition

Named entity recognition (NER) is the task to detect and classify the en...

3 Hang Yan, et al. ∙

research

∙ 05/29/2022

CoNT: Contrastive Neural Text Generation

Recently, contrastive learning attracts increasing interests in neural t...

0 Chenxin An, et al. ∙

research

∙ 05/27/2022

What Dense Graph Do You Need for Self-Attention?

Transformers have made progress in miscellaneous tasks, but suffer from ...

0 Yuxing Wang, et al. ∙

research

∙ 04/23/2022

Dialogue Meaning Representation for Task-Oriented Dialogue Systems

Dialogue meaning representation formulates natural language utterance se...

0 Xiangkun Hu, et al. ∙

research

∙ 03/27/2022

Rebuild and Ensemble: Exploring Defense Against Text Adversaries

Adversarial attacks can mislead strong neural models; as such, in NLP ta...

0 Linyang Li, et al. ∙

research

∙ 03/12/2022

MarkBERT: Marking Word Boundaries Improves Chinese BERT

We present a Chinese BERT model dubbed MarkBERT that uses word informati...

12 Linyang Li, et al. ∙

research

∙ 03/01/2022

"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction

Whole word masking (WWM), which masks all subwords corresponding to a wo...

2 Yong Dai, et al. ∙

research

∙ 02/20/2022

𝒴-Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning

With the success of large-scale pre-trained models (PTMs), how efficient...

0 Yitao Liu, et al. ∙

research

∙ 02/18/2022

TURNER: The Uncertainty-based Retrieval Framework for Chinese NER

Chinese NER is a difficult undertaking due to the ambiguity of Chinese c...

0 Zhichao Geng, et al. ∙

research

∙ 02/14/2022

Conditional Generation Net for Medication Recommendation

Medication recommendation targets to provide a proper set of medicines a...

0 Rui Wu, et al. ∙

research

∙ 01/26/2022

CodeRetriever: Unimodal and Bimodal Contrastive Learning

In this paper, we propose the CodeRetriever model, which combines the un...

3 Xiaonan Li, et al. ∙

research

∙ 01/24/2022

Towards Collaborative Question Answering: A Preliminary Study

Knowledge and expertise in the real-world can be disjointedly owned. To ...

0 Xiangkun Hu, et al. ∙

research

∙ 12/21/2021

Contrast and Generation Make BART a Good Dialogue Emotion Recognizer

In dialogue systems, utterances with similar semantics may have distinct...

0 Shimin Li, et al. ∙

research

∙ 10/14/2021

Towards More Effective and Economic Sparsely-Activated Model

The sparsely-activated models have achieved great success in natural lan...

0 Hao Jiang, et al. ∙

research

∙ 10/13/2021

Towards Efficient NLP: A Standard Evaluation and A Strong Baseline

Supersized pre-trained language models have pushed the accuracy of vario...

0 Xiangyang Liu, et al. ∙

research

∙ 10/06/2021

KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier

Pre-trained models are widely used in fine-tuning downstream tasks with ...

0 Linyang Li, et al. ∙

research

∙ 09/26/2021

Paradigm Shift in Natural Language Processing

In the era of deep learning, modeling for most NLP tasks has converged t...

0 Tianxiang Sun, et al. ∙

research

∙ 09/16/2021

RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization

Existing summarization systems mostly generate summaries purely relying ...

0 Chenxin An, et al. ∙

research

∙ 09/13/2021

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

In this paper, we take the advantage of previous pre-trained models (PTM...

0 Yunfan Shao, et al. ∙

research

∙ 09/10/2021

Learning to Teach with Student Feedback

Knowledge distillation (KD) has gained much attention due to its effecti...

0 Yitao Liu, et al. ∙

research

∙ 08/31/2021

Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoning

Pre-Trained Models have been widely applied and recently proved vulnerab...

0 Linyang Li, et al. ∙

Xipeng Qiu

Featured Co-authors