b'Zhiyuan Liu'

research

∙ 09/19/2023

QASnowball: An Iterative Bootstrapping Framework for High-Quality Question-Answering Data Generation

Recent years have witnessed the success of question answering (QA), espe...

0 Kunlun Zhu, et al. ∙

research

∙ 09/18/2023

Instant Photorealistic Style Transfer: A Lightweight and Adaptive Approach

In this paper, we propose an Instant Photorealistic Style Transfer (IPST...

0 Rong Liu, et al. ∙

research

∙ 09/15/2023

Empowering Private Tutoring by Chaining Large Language Models

Artificial intelligence has been applied in various aspects of online ed...

0 Yulin Chen, et al. ∙

research

∙ 08/27/2023

Text Matching Improves Sequential Recommendation by Reducing Popularity Biases

This paper proposes Text mAtching based SequenTial rEcommendation model ...

0 Zhenghao Liu, et al. ∙

research

∙ 08/24/2023

Large Language Model as Autonomous Decision Maker

While large language models (LLMs) exhibit impressive language understan...

0 Yining Ye, et al. ∙

research

∙ 08/21/2023

AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors in Agents

Autonomous agents empowered by Large Language Models (LLMs) have undergo...

0 Weize Chen, et al. ∙

research

∙ 08/14/2023

ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate

Text evaluation has historically posed significant challenges, often dem...

0 Chi-Min Chan, et al. ∙

research

∙ 08/10/2023

LLM As DBA

Database administrators (DBAs) play a crucial role in managing, maintain...

0 Xuanhe Zhou, et al. ∙

research

∙ 07/31/2023

ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs

Despite the advancements of open-source large language models (LLMs) and...

0 Yujia Qin, et al. ∙

research

∙ 07/28/2023

Exploring Format Consistency for Instruction Tuning

Instruction tuning has emerged as a promising approach to enhancing larg...

0 Shihao Liang, et al. ∙

research

∙ 07/16/2023

Communicative Agents for Software Development

Software engineering is a domain characterized by intricate decision-mak...

0 Chen Qian, et al. ∙

research

∙ 07/15/2023

CPET: Effective Parameter-Efficient Tuning for Compressed Large Language Models

Parameter-efficient tuning (PET) has been widely explored in recent year...

0 Weilin Zhao, et al. ∙

research

∙ 07/05/2023

OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models

The scale of large pre-trained models (PTMs) poses significant challenge...

0 Shengding Hu, et al. ∙

research

∙ 07/05/2023

Won't Get Fooled Again: Answering Questions with False Premises

Pre-trained language models (PLMs) have shown unprecedented potential in...

0 Shengding Hu, et al. ∙

research

∙ 06/27/2023

Automatic Truss Design with Reinforcement Learning

Truss layout design, namely finding a lightweight truss layout satisfyin...

0 Weihua Du, et al. ∙

research

∙ 06/21/2023

Interactive Molecular Discovery with Natural Language

Natural language is expected to be a key medium for various human-machin...

0 Zheni Zeng, et al. ∙

research

∙ 06/15/2023

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

The unprecedented performance of large language models (LLMs) necessitat...

0 Jifan Yu, et al. ∙

research

∙ 06/12/2023

The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation

Event extraction (EE) is a crucial task aiming at extracting events from...

0 Hao Peng, et al. ∙

research

∙ 06/07/2023

Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations

This paper reexamines the research on out-of-distribution (OOD) robustne...

0 Lifan Yuan, et al. ∙

research

∙ 06/04/2023

Arbitrary Few Parameters are Good Enough for Adapting Large-scale Pre-trained Language Models

Parameter-efficient tuning (PET) methods can effectively drive extremely...

2 Yusheng Su, et al. ∙

research

∙ 05/31/2023

Structure-Aware Language Model Pretraining Improves Dense Retrieval on Structured Data

This paper presents Structure Aware Dense Retrieval (SANTA) model, which...

0 Xinze Li, et al. ∙

research

∙ 05/31/2023

Exploring Lottery Prompts for Pre-trained Language Models

Consistently scaling pre-trained language models (PLMs) imposes substant...

0 Yulin Chen, et al. ∙

research

∙ 05/29/2023

From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework

Textual adversarial attacks can discover models' weaknesses by adding se...

0 Yangyi Chen, et al. ∙

research

∙ 05/28/2023

Emergent Modularity in Pre-trained Transformers

This work examines the presence of modularity in pre-trained Transformer...

0 Zhengyan Zhang, et al. ∙

research

∙ 05/28/2023

Plug-and-Play Knowledge Injection for Pre-trained Language Models

Injecting external knowledge can improve the performance of pre-trained ...

0 Zhengyan Zhang, et al. ∙

research

∙ 05/28/2023

Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning

Parameter-efficient tuning methods (PETs) have achieved promising result...

0 Weize Chen, et al. ∙

research

∙ 05/28/2023

Plug-and-Play Document Modules for Pre-trained Models

Large-scale pre-trained models (PTMs) have been widely used in document-...

0 Chaojun Xiao, et al. ∙

research

∙ 05/27/2023

Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-In

Retrieval augmentation can aid language models (LMs) in knowledge-intens...

0 Zichun Yu, et al. ∙

research

∙ 05/24/2023

Fusion-in-T5: Unifying Document Ranking Signals for Improved Information Retrieval

Common IR pipelines are typically cascade systems that may involve multi...

0 Shi Yu, et al. ∙

research

∙ 05/23/2023

CREATOR: Disentangling Abstract and Concrete Reasonings of Large Language Models through Tool Creation

Large Language Models (LLMs) have demonstrated significant progress in u...

0 Cheng Qian, et al. ∙

research

∙ 05/23/2023

Enhancing Chat Language Models by Scaling High-quality Instructional Conversations

Fine-tuning on instruction data has been widely validated as an effectiv...

0 Ning Ding, et al. ∙

research

∙ 05/19/2023

Efficient Cross-Lingual Transfer for Chinese Stable Diffusion with Images as Pivots

Diffusion models have made impressive progress in text-to-image synthesi...

0 Jinyi Hu, et al. ∙

research

∙ 05/15/2023

Recyclable Tuning for Continual Pre-training

Continual pre-training is the paradigm where pre-trained language models...

0 Yujia Qin, et al. ∙

research

∙ 05/11/2023

WebCPM: Interactive Web Search for Chinese Long-form Question Answering

Long-form question answering (LFQA) aims at answering complex, open-ende...

0 Yujia Qin, et al. ∙

research

∙ 05/04/2023

Revisiting Graph Contrastive Learning for Anomaly Detection

Combining Graph neural networks (GNNs) with contrastive learning for ano...

0 Zhiyuan Liu, et al. ∙

research

∙ 05/02/2023

Transfer Visual Prompt Generator across LLMs

While developing a new vision-language LLM (VL-LLM) by pre-training on t...

0 Ao Zhang, et al. ∙

research

∙ 04/17/2023

Tool Learning with Foundation Models

Humans possess an extraordinary ability to create and utilize tools, all...

1 Yujia Qin, et al. ∙

research

∙ 04/12/2023

Rethinking Dense Retrieval's Few-Shot Ability

Few-shot dense retrieval (DR) aims to effectively generalize to novel se...

0 Si Sun, et al. ∙

research

∙ 04/08/2023

Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder

The sequence-to-sequence (seq2seq) task aims at generating the target se...

0 Zihao Fu, et al. ∙

research

∙ 02/19/2023

Human Emotion Knowledge Representation Emerges in Large Language Model and Supports Discrete Emotion Inference

How humans infer discrete emotions is a fundamental research question in...

6 Ming Li, et al. ∙

research

∙ 02/14/2023

READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises

For many real-world applications, the user-generated inputs usually cont...

0 Chenglei Si, et al. ∙

research

∙ 02/10/2023

Semi-supervised Large-scale Fiber Detection in Material Images with Synthetic Data

Accurate detection of large-scale, elliptical-shape fibers, including th...

0 Lan Fu, et al. ∙

research

∙ 12/16/2022

Decoder Tuning: Efficient Language Understanding as Decoding

With the evergrowing sizes of pre-trained models (PTMs), it has been an ...

0 Ganqu Cui, et al. ∙

research

∙ 12/11/2022

Mul-GAD: a semi-supervised graph anomaly detection framework via aggregating multi-view information

Anomaly detection is defined as discovering patterns that do not conform...

0 Zhiyuan Liu, et al. ∙

research

∙ 11/22/2022

Visually Grounded Commonsense Knowledge Acquisition

Large-scale commonsense knowledge bases empower a broad range of AI appl...

0 Yuan Yao, et al. ∙

research

∙ 11/14/2022

Finding Skill Neurons in Pre-trained Transformer-based Language Models

Transformer-based pre-trained language models have demonstrated superior...

0 Xiaozhi Wang, et al. ∙

research

∙ 11/14/2022

MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction

The diverse relationships among real-world events, including coreference...

0 Xiaozhi Wang, et al. ∙

research

∙ 11/10/2022

Few-shot Classification with Hypersphere Modeling of Prototypes

Metric-based meta-learning is one of the de facto standards in few-shot ...

0 Ning Ding, et al. ∙

research

∙ 10/31/2022

A Close Look into the Calibration of Pre-trained Language Models

Pre-trained language models (PLMs) achieve remarkable performance on man...

0 Yangyi Chen, et al. ∙

research

∙ 10/31/2022

Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negatives

In this paper, we investigate the instability in the standard dense retr...

0 Si Sun, et al. ∙

Zhiyuan Liu

Featured Co-authors