research
∙
08/31/2023
SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models
Current speech large language models build upon discrete speech represen...
share
research
∙
08/05/2023
EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Education
EduChat (https://www.educhat.top/) is a large-scale language model (LLM)...
research
∙
08/03/2023
Does Correction Remain A Problem For Large Language Models?
As large language models, such as GPT, continue to advance the capabilit...
research
∙
06/19/2023
Distributed Marker Representation for Ambiguous Discourse Markers and Entangled Relations
Discourse analysis is an important task because it models intrinsic sema...
research
∙
06/16/2023
Full Parameter Fine-tuning for Large Language Models with Limited Resources
Large Language Models (LLMs) have revolutionized Natural Language Proces...
research
∙
06/16/2023
From Hypergraph Energy Functions to Hypergraph Neural Networks
Hypergraphs are a powerful abstraction for representing higher-order int...
research
∙
05/30/2023
An AMR-based Link Prediction Approach for Document-level Event Argument Extraction
Recent works have introduced Abstract Meaning Representation (AMR) for D...
research
∙
05/29/2023
Do Large Language Models Know What They Don't Know?
Large language models (LLMs) have a wealth of knowledge that allows them...
research
∙
05/25/2023
Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System
Dialogue data in real scenarios tend to be sparsely available, rendering...
research
∙
05/21/2023
Evaluating the Performance of Large Language Models on GAOKAO Benchmark
Large language models have demonstrated remarkable performance across va...
research
∙
05/20/2023
PromptNER: A Prompting Method for Few-shot Named Entity Recognition via k Nearest Neighbor Search
Few-shot Named Entity Recognition (NER) is a task aiming to identify nam...
research
∙
05/18/2023
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Multi-modal large language models are regarded as a crucial step towards...
research
∙
05/09/2023
MoT: Pre-thinking and Recalling Enable ChatGPT to Self-Improve with Memory-of-Thoughts
Large Language Models have shown impressive abilities on various tasks. ...
research
∙
05/07/2023
Unified Demonstration Retriever for In-Context Learning
In-context learning is a new learning paradigm where a language model co...
research
∙
02/27/2023
Finding Supporting Examples for In-Context Learning
In-context learning is a new learning paradigm where a language model ob...
research
∙
12/19/2022
Rethinking Label Smoothing on Multi-hop Question Answering
Label smoothing is a regularization technique widely used in supervised ...
research
∙
12/14/2022
Mitigating Negative Style Transfer in Hybrid Dialogue System
As the functionality of dialogue systems evolves, hybrid dialogue system...
research
∙
12/08/2022
Investigating Glyph Phonetic Information for Chinese Spell Checking: What Works and What's Next
While pre-trained Chinese language models have demonstrated impressive p...
research
∙
11/23/2022
Word-Level Representation From Bytes For Language Modeling
Modern language models mostly take sub-words as input, a design that bal...
research
∙
10/31/2022
SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking
Due to the ambiguity of homophones, Chinese Spell Checking (CSC) has wid...
research
∙
10/31/2022
RLET: A Reinforcement Learning Based Approach for Explainable QA with Entailment Trees
Interpreting the reasoning process from questions to answers poses a cha...
research
∙
10/28/2022
DORE: Document Ordered Relation Extraction based on Generative Framework
In recent years, there is a surge of generation-based information extrac...
research
∙
10/26/2022
Is MultiWOZ a Solved Task? An Interactive TOD Evaluation Framework with User Simulator
Task-Oriented Dialogue (TOD) systems are drawing more and more attention...
research
∙
10/21/2022
Discovering New Intents Using Latent Variables
Discovering new intents is of great significance to establishing Bootstr...
research
∙
10/18/2022
Soft-Labeled Contrastive Pre-training for Function-level Code Representation
Code contrastive pre-training has recently achieved significant progress...
research
∙
10/13/2022
An Open-World Lottery Ticket for Out-of-Domain Intent Classification
Most existing methods of Out-of-Domain (OOD) intent classification, whic...
research
∙
09/29/2022
COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization
Traditional training paradigms for extractive and abstractive summarizat...
research
∙
09/23/2022
A Unified Generative Framework based on Prompt Learning for Various Information Extraction Tasks
Prompt learning is an effective paradigm that bridges gaps between the p...
research
∙
08/19/2022
Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding
Generalized text representations are the foundation of many natural lang...
research
∙
08/09/2022
An Embarrassingly Easy but Strong Baseline for Nested Named Entity Recognition
Named entity recognition (NER) is the task to detect and classify the en...
research
∙
05/29/2022
CoNT: Contrastive Neural Text Generation
Recently, contrastive learning attracts increasing interests in neural t...
research
∙
05/27/2022
What Dense Graph Do You Need for Self-Attention?
Transformers have made progress in miscellaneous tasks, but suffer from ...
research
∙
04/23/2022
Dialogue Meaning Representation for Task-Oriented Dialogue Systems
Dialogue meaning representation formulates natural language utterance se...
research
∙
03/27/2022
Rebuild and Ensemble: Exploring Defense Against Text Adversaries
Adversarial attacks can mislead strong neural models; as such, in NLP ta...
research
∙
03/12/2022
MarkBERT: Marking Word Boundaries Improves Chinese BERT
We present a Chinese BERT model dubbed MarkBERT that uses word informati...
research
∙
03/01/2022
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction
Whole word masking (WWM), which masks all subwords corresponding to a wo...
research
∙
02/20/2022
𝒴-Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning
With the success of large-scale pre-trained models (PTMs), how efficient...
research
∙
02/18/2022
TURNER: The Uncertainty-based Retrieval Framework for Chinese NER
Chinese NER is a difficult undertaking due to the ambiguity of Chinese c...
research
∙
02/14/2022
Conditional Generation Net for Medication Recommendation
Medication recommendation targets to provide a proper set of medicines a...
research
∙
01/26/2022
CodeRetriever: Unimodal and Bimodal Contrastive Learning
In this paper, we propose the CodeRetriever model, which combines the un...
research
∙
01/24/2022
Towards Collaborative Question Answering: A Preliminary Study
Knowledge and expertise in the real-world can be disjointedly owned. To ...
research
∙
12/21/2021
Contrast and Generation Make BART a Good Dialogue Emotion Recognizer
In dialogue systems, utterances with similar semantics may have distinct...
research
∙
10/14/2021
Towards More Effective and Economic Sparsely-Activated Model
The sparsely-activated models have achieved great success in natural lan...
research
∙
10/13/2021
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline
Supersized pre-trained language models have pushed the accuracy of vario...
research
∙
10/06/2021
KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier
Pre-trained models are widely used in fine-tuning downstream tasks with ...
research
∙
09/26/2021
Paradigm Shift in Natural Language Processing
In the era of deep learning, modeling for most NLP tasks has converged t...
research
∙
09/16/2021
RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization
Existing summarization systems mostly generate summaries purely relying ...
research
∙
09/13/2021
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
In this paper, we take the advantage of previous pre-trained models (PTM...
research
∙
09/10/2021
Learning to Teach with Student Feedback
Knowledge distillation (KD) has gained much attention due to its effecti...
research
∙
08/31/2021
