Zhiyuan Liu

is this you? claim profile

∙

0 followers

∙

Northeastern University

∙

National University of Singapore

∙

University of Colorado Boulder

∙

University of Technology Sydney

∙

University of Southern California

∙

University of North Carolina at Chapel Hill

∙

Tsinghua University

∙

Nanyang Technological University

Associate Professor at Tsinghua University since 2017, Assistant Professor at Tsinghua University since 2016, Assistant Researcher at Tsinghua University since 2013, Post-doc at Tsinghua University from 2011-2013, Research intern at Google from 2008-2011.

Featured Co-authors

Yang Liu
344 publications
Wei Zhang
290 publications
Jie Zhou
234 publications
Wei Li
224 publications
Jianfeng Gao
205 publications
Bo Zhang
171 publications
Ting Liu
153 publications
Chao Li
124 publications
Maosong Sun
121 publications
Tat-Seng Chua
119 publications
Xu Chen
116 publications

∙ 07/12/2022

Effective Few-Shot Named Entity Linking by Meta-Learning

Entity linking aims to link ambiguous mentions to their corresponding en...

Xiuxing Li, et al. ∙

∙ 06/22/2022

GACT: Activation Compressed Training for General Architectures

Training large neural network (NN) models requires extensive memory reso...

Xiaoxuan Liu, et al. ∙

∙ 06/19/2022

A Unified Understanding of Deep NLP Models for Text Classification

The rapid development of deep natural language processing (NLP) models f...

Zhen Li, et al. ∙

∙ 06/17/2022

A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks

Textual backdoor attacks are a kind of practical threat to NLP systems. ...

Ganqu Cui, et al. ∙

∙ 06/15/2022

Sparse Structure Search for Parameter-Efficient Tuning

Adapting large pre-trained models (PTMs) through fine-tuning imposes pro...

Shengding Hu, et al. ∙

∙ 05/23/2022

PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models

Vision-language pre-training (VLP) has shown impressive performance on a...

Yuan Yao, et al. ∙

∙ 05/23/2022

Prompt Tuning for Discriminative Pre-trained Language Models

Recent works have shown promising results of prompt tuning in stimulatin...

Yuan Yao, et al. ∙

∙ 05/06/2022

Dimension Reduction for Efficient Dense Retrieval via Conditional Autoencoder

Dense retrievers encode texts and map them in an embedding space using p...

Zhenghao Liu, et al. ∙

∙ 05/04/2022

P^3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning

Compared to other language tasks, applying pre-trained language models (...

Xiaomeng Hu, et al. ∙

∙ 04/11/2022

Exploring the Universal Vulnerability of Prompt-based Learning Paradigm

Prompt-based learning paradigm bridges the gap between pre-training and ...

Lei Xu, et al. ∙

∙ 03/22/2022

Fine-Grained Scene Graph Generation with Data Transfer

Scene graph generation (SGG) aims to extract (subject, predicate, object...

Ao Zhang, et al. ∙

∙ 03/18/2022

Prototypical Verbalizer for Prompt-based Few-shot Tuning

Prompt-based tuning for pre-trained language models (PLMs) has shown its...

Ganqu Cui, et al. ∙

∙ 03/16/2022

LEVEN: A Large-Scale Chinese Legal Event Detection Dataset

Recognizing facts is the most fundamental step in making judgments, henc...

Feng Yao, et al. ∙

∙ 03/14/2022

Sememe Prediction for BabelNet Synsets using Multilingual and Multimodal Information

In linguistics, a sememe is defined as the minimum semantic unit of lang...

Fanchao Qi, et al. ∙

∙ 03/12/2022

ELLE: Efficient Lifelong Pre-training for Emerging Data

Current pre-trained language models (PLM) are typically trained with sta...

Yujia Qin, et al. ∙

∙ 02/27/2022

A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models

Pre-trained language models (PLMs) cannot well recall rich factual knowl...

Deming Ye, et al. ∙

∙ 02/26/2022

QuoteR: A Benchmark of Quote Recommendation for Writing

It is very common to use quotations (quotes) to make our writings more e...

Fanchao Qi, et al. ∙

∙ 01/14/2022

Training Free Graph Neural Networks for Graph Matching

We present TFGM (Training Free Graph Matching), a framework to boost the...

Zhiyuan Liu, et al. ∙

∙ 12/12/2021

Video as Conditional Graph Hierarchy for Multi-Granular Question Answering

Video question answering requires the models to understand and reason ab...

Junbin Xiao, et al. ∙

∙ 12/03/2021

Multi-modal application: Image Memes Generation

Meme is an interesting word. Internet memes offer unique insights into t...

Zhiyuan Liu, et al. ∙

∙ 11/12/2021

On Transferability of Prompt Tuning for Natural Language Understanding

Prompt tuning (PT) is a promising parameter-efficient method to utilize ...

Yusheng Su, et al. ∙

∙ 11/03/2021

OpenPrompt: An Open-source Framework for Prompt-learning

Prompt-learning has become a new paradigm in modern natural language pro...

Ning Ding, et al. ∙

∙ 10/15/2021

Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks

Backdoor attacks are a kind of emergent security threat in deep learning...

Yangyi Chen, et al. ∙

∙ 10/15/2021

Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning

How can pre-trained language models (PLMs) learn universal representatio...

Yujia Qin, et al. ∙

∙ 10/14/2021

Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer

Adversarial attacks and backdoor attacks are two common security threats...

Fanchao Qi, et al. ∙

∙ 10/05/2021

MoEfication: Conditional Computation of Transformer Models for Efficient Inference

Transformer-based pre-trained language models can achieve superior perfo...

Zhengyan Zhang, et al. ∙

∙ 09/24/2021

CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models

Pre-Trained Vision-Language Models (VL-PTMs) have shown promising capabi...

Yuan Yao, et al. ∙

∙ 09/09/2021

TIAGE: A Benchmark for Topic-Shift Aware Dialog Modeling

Human conversations naturally evolve around different topics and fluentl...

Huiyuan Xie, et al. ∙

∙ 09/09/2021

PPT: Pre-trained Prompt Tuning for Few-shot Learning

Prompts for pre-trained language models (PLMs) have shown remarkable per...

Yuxian Gu, et al. ∙

∙ 09/06/2021

Non-Euclidean Analysis of Joint Variations in Multi-Object Shapes

This paper considers joint analysis of multiple functionally related str...

Zhiyuan Liu, et al. ∙

∙ 08/24/2021

Prompt-Learning for Fine-Grained Entity Typing

As an effective approach to tune pre-trained language models (PLMs) for ...

Ning Ding, et al. ∙

∙ 08/22/2021

ICLR 2021 Challenge for Computational Geometry Topology: Design and Results

This paper presents the computational challenge on differential geometry...

Nina Miolane, et al. ∙

∙ 08/04/2021

Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification

Tuning pre-trained language models (PLMs) with task-specific prompts has...

Shengding Hu, et al. ∙

∙ 07/26/2021

Robotic Occlusion Reasoning for Efficient Object Existence Prediction

Reasoning about potential occlusions is essential for robots to efficien...

Mengdi Li, et al. ∙

∙ 07/16/2021

More Robust Dense Retrieval with Contrastive Dual Learning

Dense retrieval conducts text retrieval in the embedding space and has s...

Yizhi Li, et al. ∙

∙ 06/27/2021

From Symbols to Embeddings: A Tale of Two Representations in Computational Social Science

Computational Social Science (CSS), aiming at utilizing computational me...

Huimin Chen, et al. ∙

∙ 06/15/2021

Evaluating Modules in Graph Contrastive Learning

The recent emergence of contrastive learning approaches facilitates the ...

Ganqu Cui, et al. ∙

∙ 06/11/2021

Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution

Recent studies show that neural natural language processing (NLP) models...

Fanchao Qi, et al. ∙

∙ 06/01/2021

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining

Conventional tokenization methods for Chinese pretrained language models...

Chenglei Si, et al. ∙

∙ 05/31/2021

Fully Hyperbolic Neural Networks

Hyperbolic neural networks have shown great potential for modeling compl...

Weize Chen, et al. ∙

∙ 05/30/2021

CLEVE: Contrastive Pre-training for Event Extraction

Event extraction (EE) has considerably benefited from pre-trained langua...

Ziqi Wang, et al. ∙

∙ 05/28/2021

Knowledge Inheritance for Pre-trained Language Models

Recent explorations of large-scale pre-trained language models (PLMs) su...

Yujia Qin, et al. ∙

∙ 05/26/2021

Automatic Construction of Sememe Knowledge Bases via Dictionaries

A sememe is defined as the minimum semantic unit in linguistics. Sememe ...

Fanchao Qi, et al. ∙

∙ 05/26/2021

Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger

Backdoor attacks are a kind of insidious security threat against machine...

Fanchao Qi, et al. ∙

∙ 05/24/2021

PTR: Prompt Tuning with Rules for Text Classification

Fine-tuned pre-trained language models (PLMs) have achieved awesome perf...

Xu Han, et al. ∙

∙ 05/20/2021

Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction

Distantly supervised (DS) relation extraction (RE) has attracted much at...

Tianyu Gao, et al. ∙

∙ 05/16/2021

Few-NERD: A Few-Shot Named Entity Recognition Dataset

Recently, considerable literature has grown up around the theme of few-s...

Ning Ding, et al. ∙

∙ 05/10/2021

Few-Shot Conversational Dense Retrieval

Dense retrieval (DR) has the potential to resolve the query understandin...

Shi Yu, et al. ∙

∙ 05/09/2021

Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

Legal artificial intelligence (LegalAI) aims to benefit legal systems wi...

Chaojun Xiao, et al. ∙

∙ 04/14/2021

Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability

Multi-hop reasoning has been widely studied in recent years to obtain mo...

Xin Lv, et al. ∙