Songfang Huang

research

∙ 07/17/2023

BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization

Vision Transformer (ViT) based Vision-Language Pre-training (VLP) models...

0 Chaoya Jiang, et al. ∙

research

∙ 06/24/2023

DiffDTM: A conditional structure-free framework for bioactive molecules generation targeted for dual proteins

Advances in deep generative models shed light on de novo molecule genera...

0 Lei Huang, et al. ∙

research

∙ 05/24/2023

Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning

Fine-tuning large pre-trained language models on various downstream task...

0 Zhen-Ru Zhang, et al. ∙

research

∙ 04/17/2023

VECO 2.0: Cross-lingual Language Model Pre-training with Multi-granularity Contrastive Learning

Recent studies have demonstrated the potential of cross-lingual transfer...

0 Zhen-Ru Zhang, et al. ∙

research

∙ 04/11/2023

RRHF: Rank Responses to Align Language Models with Human Feedback without tears

Reinforcement Learning from Human Feedback (RLHF) facilitates the alignm...

0 Zheng Yuan, et al. ∙

research

∙ 03/18/2023

Revisiting Automatic Question Summarization Evaluation in the Biomedical Domain

Automatic evaluation metrics have been facilitating the rapid developmen...

0 Hongyi Yuan, et al. ∙

research

∙ 03/01/2023

RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training

Vision-and-language multi-modal pretraining and fine-tuning have shown g...

0 Zheng Yuan, et al. ∙

research

∙ 02/02/2023

Molecular Geometry-aware Transformer for accurate 3D Atomic System modeling

Molecular dynamic simulations are important in computational physics, ch...

0 Zheng Yuan, et al. ∙

research

∙ 02/01/2023

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video

Recent years have witnessed a big convergence of language, vision, and m...

0 Haiyang Xu, et al. ∙

research

∙ 01/05/2023

Adaptively Clustering Neighbor Elements for Image Captioning

We design a novel global-local Transformer named Ada-ClustFormer (ACF) t...

0 Zihua Wang, et al. ∙

research

∙ 01/05/2023

Learning Trajectory-Word Alignments for Video-Language Tasks

Aligning objects with words plays a critical role in Image-Language BERT...

0 Xu Yang, et al. ∙

research

∙ 12/20/2022

SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers

Diffusion model, a new generative modelling paradigm, has achieved great...

0 Hongyi Yuan, et al. ∙

research

∙ 12/17/2022

HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation

Language models with the Transformers structure have shown great perform...

0 Hongyi Yuan, et al. ∙

research

∙ 10/17/2022

SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition

Few-shot Named Entity Recognition (NER) aims to identify named entities ...

0 Jianing Wang, et al. ∙

research

∙ 08/18/2022

Open Information Extraction from 2007 to 2022 – A Survey

Open information extraction is an important NLP task that targets extrac...

15 Pai Liu, et al. ∙

research

∙ 05/24/2022

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections

Large-scale pretrained foundation models have been an emerging paradigm ...

0 Chenliang Li, et al. ∙

research

∙ 05/23/2022

Parameter-Efficient Sparsity for Large Language Models Fine-Tuning

With the dramatically increased number of parameters in language models,...

0 Yuchao Li, et al. ∙

research

∙ 05/11/2022

Towards Unified Prompt Tuning for Few-shot Text Classification

Prompt-based fine-tuning has boosted the performance of Pre-trained Lang...

0 Jianing Wang, et al. ∙

research

∙ 04/15/2022

Image Captioning In the Transformer Age

Image Captioning (IC) has achieved astonishing developments by incorpora...

0 Yang Xu, et al. ∙

research

∙ 04/09/2022

Contrastive Demonstration Tuning for Pre-trained Language Models

Pretrained language models can be effectively stimulated by textual prom...

0 Xiaozhuan Liang, et al. ∙

research

∙ 04/06/2022

Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency

Structured pruning has been extensively studied on monolingual pre-train...

0 Yanyang Li, et al. ∙

research

∙ 04/01/2022

Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning

Pre-trained Language Models (PLMs) have achieved remarkable performance ...

0 Ziyun Xu, et al. ∙

research

∙ 03/03/2022

Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding

Automatic ICD coding is defined as assigning disease codes to electronic...

0 Zheng Yuan, et al. ∙

research

∙ 12/14/2021

From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression

Pre-trained Language Models (PLMs) have achieved great success in variou...

0 Runxin Xu, et al. ∙

research

∙ 12/02/2021

LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training

Natural language generation from structured data mainly focuses on surfa...

0 Ningyu Zhang, et al. ∙

research

∙ 11/17/2021

Achieving Human Parity on Visual Question Answering

The Visual Question Answering (VQA) task utilizes both visual image and ...

0 Ming Yan, et al. ∙

research

∙ 11/11/2021

A Chinese Multi-type Complex Questions Answering Dataset over Wikidata

Complex Knowledge Base Question Answering is a popular area of research ...

0 Jianyun Zou, et al. ∙

research

∙ 10/14/2021

Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition

Nested entities are observed in many domains due to their compositionali...

0 Zheng Yuan, et al. ∙

research

∙ 09/13/2021

Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning

Recent pretrained language models extend from millions to billions of pa...

0 Runxin Xu, et al. ∙

research

∙ 06/03/2021

E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning

Vision-language pre-training (VLP) on large-scale image-text pairs has a...

0 Haiyang Xu, et al. ∙

research

∙ 05/24/2021

StructuralLM: Structural Pre-training for Form Understanding

Large pre-trained language models achieve state-of-the-art results when ...

0 Chenliang Li, et al. ∙

research

∙ 04/21/2021

Improving Biomedical Pretrained Language Models with Knowledge

Pretrained language models have shown success in many natural language p...

0 Zheng Yuan, et al. ∙

research

∙ 04/15/2021

Automated Conformance Testing for JavaScript Engines via Deep Compiler Fuzzing

JavaScript (JS) is a popular, platform-independent programming language....

0 Guixin Ye, et al. ∙

research

∙ 04/15/2021

Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models

Chinese pre-trained language models usually process text as a sequence o...

0 Yuxuan Lai, et al. ∙

research

∙ 04/09/2021

Noisy-Labeled NER with Confidence Estimation

Recent studies in deep learning have shown significant progress in named...

0 Kun Liu, et al. ∙

research

∙ 03/14/2021

SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels

Vision-language pre-training (VLP) on large-scale image-text pairs has r...

0 Chenliang Li, et al. ∙

research

∙ 02/10/2021

Biomedical Question Answering: A Comprehensive Review

Question Answering (QA) is a benchmark Natural Language Processing (NLP)...

0 Qiao Jin, et al. ∙

research

∙ 12/15/2020

Nested Named Entity Recognition with Partially-Observed TreeCRFs

Named entity recognition (NER) is a well-studied task in natural languag...

0 Yao Fu, et al. ∙

research

∙ 10/30/2020

VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation

Recent studies about learning multilingual representations have achieved...

0 Fuli Luo, et al. ∙

research

∙ 10/12/2020

Predicting Clinical Trial Results by Implicit Evidence Integration

Clinical trials provide essential guidance for practicing Evidence-Based...

0 Qiao Jin, et al. ∙

research

∙ 11/09/2018

Encoding Implicit Relation Requirements for Relation Extraction: A Joint Inference Approach

Relation extraction is the task of identifying predefined relationship b...

0 Liwei Chen, et al. ∙

research

∙ 05/15/2018

Marrying up Regular Expressions with Neural Networks: A Case Study for Spoken Language Understanding

The success of many natural language processing (NLP) tasks is bound by ...

0 Bingfeng Luo, et al. ∙

research

∙ 05/11/2017

Learning with Noise: Enhance Distantly Supervised Relation Extraction with Dynamic Transition Matrix

Distant supervision significantly reduces human efforts in building trai...

0 Bingfeng Luo, et al. ∙

research

∙ 03/03/2016

Question Answering on Freebase via Relation Extraction and Textual Evidence

Existing knowledge-based question answering systems often rely on small ...

0 Kun Xu, et al. ∙

research

∙ 06/25/2015

Semantic Relation Classification via Convolutional Neural Networks with Simple Negative Sampling

Syntactic features play an essential role in identifying relationship in...

0 Kun Xu, et al. ∙

Songfang Huang

Featured Co-authors