Zhilin Yang

is this you? claim profile

∙ 0 followers
Google ∙ Tsinghua University ∙ Carnegie Mellon University

PhD student at the Language Technologies Institute, School of Computer Science at Carnegie Mellon University.

Distribution Matching for Rationalization

The task of rationalization aims to extract pieces of input text as rati...
06/01/2021 ∙ by Yongfeng Huang, et al. ∙ 0 ∙ share

read it
FastMoE: A Fast Mixture-of-Expert Training System

Mixture-of-Expert (MoE) presents a strong potential in enlarging the siz...
03/24/2021 ∙ by Jiaao He, et al. ∙ 0 ∙ share

read it
Controllable Generation from Pre-trained Language Models via Inverse Prompting

Large-scale pre-trained language models have demonstrated strong capabil...
03/19/2021 ∙ by Xu Zou, et al. ∙ 0 ∙ share

read it
GPT Understands, Too

While GPTs with traditional fine-tuning fail to achieve strong results o...
03/18/2021 ∙ by Xiao Liu, et al. ∙ 21 ∙ share

read it
All NLP Tasks Are Generation Tasks: A General Pretraining Framework

There have been various types of pretraining architectures including aut...
03/18/2021 ∙ by Zhengxiao Du, et al. ∙ 0 ∙ share

read it
XLNet: Generalized Autoregressive Pretraining for Language Understanding

With the capability of modeling bidirectional contexts, denoising autoen...
06/19/2019 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

Transformer networks have a potential of learning longer-term dependency...
01/09/2019 ∙ by Zihang Dai, et al. ∙ 2 ∙ share

read it
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering

Existing question answering (QA) datasets fail to train QA systems to pe...
09/25/2018 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Neural Cross-Lingual Named Entity Recognition with Minimal Resources

For languages with no annotated resources, unsupervised transfer of natu...
08/29/2018 ∙ by Jiateng Xie, et al. ∙ 0 ∙ share

read it
GLoMo: Unsupervisedly Learned Relational Graphs as Transferable Representations

Modern deep transfer learning approaches have mainly focused on learning...
06/14/2018 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Neural Models for Reasoning over Multiple Mentions using Coreference

Many problems in NLP require aggregating information from multiple menti...
04/16/2018 ∙ by Bhuwan Dhingra, et al. ∙ 0 ∙ share

read it
Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent

Contrary to most natural language processing research, which makes use o...
11/21/2017 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Breaking the Softmax Bottleneck: A High-Rank RNN Language Model

We formulate language modeling as a matrix factorization problem, and sh...
11/10/2017 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Good Semi-supervised Learning that Requires a Bad GAN

Semi-supervised learning methods based on generative adversarial network...
05/27/2017 ∙ by Zihang Dai, et al. ∙ 0 ∙ share

read it
Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks

Recent papers have shown that neural networks obtain state-of-the-art pe...
03/18/2017 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Linguistic Knowledge as Memory for Recurrent Neural Networks

Training recurrent neural networks to model long term dependencies is di...
03/07/2017 ∙ by Bhuwan Dhingra, et al. ∙ 0 ∙ share

read it
Differentiable Learning of Logical Rules for Knowledge Base Reasoning

We study the problem of learning probabilistic first-order logical rules...
02/27/2017 ∙ by Fan Yang, et al. ∙ 0 ∙ share

read it
A Probabilistic Framework for Location Inference from Social Media

We study the extent to which we can infer users' geographical locations ...
02/23/2017 ∙ by Yujie Qian, et al. ∙ 0 ∙ share

read it
Semi-Supervised QA with Generative Domain-Adaptive Nets

We study the problem of semi-supervised question answering----utilizing ...
02/07/2017 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Words or Characters? Fine-grained Gating for Reading Comprehension

Previous work combines word-level and character-level representations us...
11/06/2016 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Gated-Attention Readers for Text Comprehension

In this paper we study the problem of answering cloze-style questions ov...
06/05/2016 ∙ by Bhuwan Dhingra, et al. ∙ 0 ∙ share

read it
Review Networks for Caption Generation

We propose a novel extension of the encoder-decoder framework, called a ...
05/25/2016 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Multi-Task Cross-Lingual Sequence Tagging from Scratch

We present a deep hierarchical recurrent neural network for sequence tag...
03/20/2016 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it
Multi-Modal Bayesian Embeddings for Learning Social Knowledge Graphs

We study the extent to which online social networks can be connected to ...
08/04/2015 ∙ by Zhilin Yang, et al. ∙ 0 ∙ share

read it

Zhilin Yang

Featured Co-authors

Yoshua Bengio

Graham Neubig

Ruslan Salakhutdinov

Fan Yang

Noah A. Smith

Quoc V. Le

Wei Wei

Yann LeCun

Xiao Liu

Jie Tang

Jason Weston

Distribution Matching for Rationalization

FastMoE: A Fast Mixture-of-Expert Training System

Controllable Generation from Pre-trained Language Models via Inverse Prompting

GPT Understands, Too

All NLP Tasks Are Generation Tasks: A General Pretraining Framework

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering

Neural Cross-Lingual Named Entity Recognition with Minimal Resources

GLoMo: Unsupervisedly Learned Relational Graphs as Transferable Representations

Neural Models for Reasoning over Multiple Mentions using Coreference

Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent

Breaking the Softmax Bottleneck: A High-Rank RNN Language Model

Good Semi-supervised Learning that Requires a Bad GAN

Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks

Linguistic Knowledge as Memory for Recurrent Neural Networks

Differentiable Learning of Logical Rules for Knowledge Base Reasoning

A Probabilistic Framework for Location Inference from Social Media

Semi-Supervised QA with Generative Domain-Adaptive Nets

Words or Characters? Fine-grained Gating for Reading Comprehension

Gated-Attention Readers for Text Comprehension

Review Networks for Caption Generation

Multi-Task Cross-Lingual Sequence Tagging from Scratch

Multi-Modal Bayesian Embeddings for Learning Social Knowledge Graphs