research
∙
08/14/2023
#InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language Models
Foundation language models obtain the instruction-following ability thro...
share
research
∙
08/03/2023
Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
Mathematical reasoning is a challenging task for large language models (...
research
∙
05/24/2023
Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
Fine-tuning large pre-trained language models on various downstream task...
research
∙
05/15/2023
Knowledge Rumination for Pre-trained Language Models
Previous studies have revealed that vanilla pre-trained language models ...
research
∙
04/17/2023
VECO 2.0: Cross-lingual Language Model Pre-training with Multi-granularity Contrastive Learning
Recent studies have demonstrated the potential of cross-lingual transfer...
research
∙
04/11/2023
RRHF: Rank Responses to Align Language Models with Human Feedback without tears
Reinforcement Learning from Human Feedback (RLHF) facilitates the alignm...
research
∙
03/01/2023
RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training
Vision-and-language multi-modal pretraining and fine-tuning have shown g...
research
∙
02/02/2023
Molecular Geometry-aware Transformer for accurate 3D Atomic System modeling
Molecular dynamic simulations are important in computational physics, ch...
research
∙
01/25/2023
One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER
Cross-domain NER is a challenging task to address the low-resource probl...
research
∙
12/20/2022
SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers
Diffusion model, a new generative modelling paradigm, has achieved great...
research
∙
12/19/2022
Reasoning with Language Model Prompting: A Survey
Reasoning, as an essential ability for complex problem-solving, can prov...
research
∙
12/17/2022
HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation
Language models with the Transformers structure have shown great perform...
research
∙
10/17/2022
SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) aims to identify named entities ...
research
∙
05/29/2022
Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning
Prompt learning approaches have made waves in natural language processin...
research
∙
05/23/2022
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning
With the dramatically increased number of parameters in language models,...
research
∙
05/11/2022
Towards Unified Prompt Tuning for Few-shot Text Classification
Prompt-based fine-tuning has boosted the performance of Pre-trained Lang...
research
∙
05/07/2022
Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction
Multimodal named entity recognition and relation extraction (MNER and MR...
research
∙
05/04/2022
Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completion
Multimodal Knowledge Graphs (MKGs), which organize visual-text factual k...
research
∙
05/04/2022
Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning
Pre-trained language models have contributed significantly to relation e...
research
∙
04/09/2022
Contrastive Demonstration Tuning for Pre-trained Language Models
Pretrained language models can be effectively stimulated by textual prom...
research
∙
03/03/2022
Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding
Automatic ICD coding is defined as assigning disease codes to electronic...
research
∙
01/14/2022
Reasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddings
Previous knowledge graph embedding approaches usually map entities to re...
research
∙
01/10/2022
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population
We present a new open-source and extensible knowledge extraction toolkit...
research
∙
12/02/2021
LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training
Natural language generation from structured data mainly focuses on surfa...
research
∙
10/14/2021
Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition
Nested entities are observed in many domains due to their compositionali...
research
∙
10/01/2021
Learning to Ask for Data-Efficient Event Argument Extraction
Event argument extraction (EAE) is an important task for information ext...
research
∙
09/13/2021
Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning
Recent pretrained language models extend from millions to billions of pa...
research
∙
08/31/2021
LightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NER
Most existing NER methods rely on extensive labeled data for model train...
research
∙
08/30/2021
Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners
Large-scale pre-trained language models have contributed significantly t...
research
∙
08/09/2021
Meta Gradient Adversarial Attack
In recent years, research on adversarial attacks has become a hot spot. ...
research
∙
06/15/2021
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark
Artificial Intelligence (AI), along with the recent progress in biomedic...
research
∙
06/07/2021
Document-level Relation Extraction as Semantic Segmentation
Document-level relation extraction aims to extract relations among multi...
research
∙
04/21/2021
Improving Biomedical Pretrained Language Models with Knowledge
Pretrained language models have shown success in many natural language p...
research
∙
04/15/2021
AdaPrompt: Adaptive Prompt-based Finetuning for Relation Extraction
In this paper, we reformulate the relation extraction task as mask langu...
research
∙
04/09/2021
Noisy-Labeled NER with Confidence Estimation
Recent studies in deep learning have shown significant progress in named...
research
∙
04/08/2021
Probing BERT in Hyperbolic Spaces
Recently, a variety of probing tasks are proposed to discover linguistic...
research
∙
04/01/2021
Normal vs. Adversarial: Salience-based Analysis of Adversarial Samples for Relation Extraction
Recent neural-based relation extraction approaches, though achieving pro...
research
∙
02/10/2021
Biomedical Question Answering: A Comprehensive Review
Question Answering (QA) is a benchmark Natural Language Processing (NLP)...
research
∙
12/15/2020
Nested Named Entity Recognition with Partially-Observed TreeCRFs
Named entity recognition (NER) is a well-studied task in natural languag...
research
∙
11/29/2020
Latent Template Induction with Gumbel-CRFs
Learning to control the structure of sentences is a challenging problem ...
research
∙
10/12/2020
Predicting Clinical Trial Results by Implicit Evidence Integration
Clinical trials provide essential guidance for practicing Evidence-Based...
research
∙
09/14/2020
Contrastive Triple Extraction with Generative Transformer
Triple extraction is an essential task in information extraction for nat...
research
∙
04/25/2019
Attention-based Transfer Learning for Brain-computer Interface
Different functional areas of the human brain play different roles in br...
research
∙
09/12/2018
Neural Melody Composition from Lyrics
In this paper, we study a novel task that learns to compose music from n...
research
∙
08/06/2018
A Survey on Deep Transfer Learning
As a new classification platform, deep learning has recently received in...
research
∙
08/06/2018
Deep Transfer Learning for EEG-based Brain Computer Interface
The electroencephalography classifier is the most important component of...
research
∙
07/24/2018
Multimodal Classification with Deep Convolutional-Recurrent Neural Networks for Electroencephalography
Electroencephalography (EEG) has become the most significant input signa...
research
∙
06/15/2017
S-Net: From Answer Extraction to Answer Generation for Machine Reading Comprehension
In this paper, we present a novel approach to machine reading comprehens...
research
∙
04/10/2017
Entity Linking for Queries by Searching Wikipedia Sentences
We present a simple yet effective approach for linking entities in queri...
research
∙
04/06/2017