b'Jingjing Liu'

EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets

Deep, heavily overparameterized language models such as BERT, XLNet and ...
12/31/2020 ∙ by Xiaohan Chen, et al. ∙ 0 ∙ share

read it
Wasserstein Contrastive Representation Distillation

The primary goal of knowledge distillation (KD) is to encapsulate the in...
12/15/2020 ∙ by Liqun Chen, et al. ∙ 0 ∙ share

read it
A Closer Look at the Robustness of Vision-and-Language Pre-trained Models

Large-scale pre-trained multimodal transformers, such as ViLBERT and UNI...
12/15/2020 ∙ by Linjie Li, et al. ∙ 1 ∙ share

read it
Cross-Thought for Sentence Encoder Pre-training

In this paper, we propose Cross-Thought, a novel approach to pre-trainin...
10/07/2020 ∙ by Shuohang Wang, et al. ∙ 0 ∙ share

read it
Multi-Fact Correction in Abstractive Text Summarization

Pre-trained neural abstractive summarization systems have dominated extr...
10/06/2020 ∙ by Yue Dong, et al. ∙ 0 ∙ share

read it
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective

Large-scale language models such as BERT have achieved state-of-the-art ...
10/05/2020 ∙ by Boxin Wang, et al. ∙ 0 ∙ share

read it
Efficient Robust Training via Backward Smoothing

Adversarial training is so far the most effective strategy in defending ...
10/03/2020 ∙ by Jinghui Chen, et al. ∙ 1 ∙ share

read it
Contrastive Distillation on Intermediate Representations for Language Model Compression

Existing language model compression methods mostly use a simple L2 loss ...
09/29/2020 ∙ by Siqi Sun, et al. ∙ 0 ∙ share

read it
Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding

Transformer has become ubiquitous in the deep learning field. One of the...
09/13/2020 ∙ by Shuohang Wang, et al. ∙ 0 ∙ share

read it
Accelerating Real-Time Question Answering via Question Generation

Existing approaches to real-time question answering (RTQA) rely on learn...
09/10/2020 ∙ by Yuwei Fang, et al. ∙ 0 ∙ share

read it
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding

Large-scale cross-lingual language models (LM), such as mBERT, Unicoder ...
09/10/2020 ∙ by Yuwei Fang, et al. ∙ 0 ∙ share

read it
Graph Optimal Transport for Cross-Domain Alignment

Cross-domain alignment between two sets of entities (e.g., objects in an...
06/26/2020 ∙ by Liqun Chen, et al. ∙ 9 ∙ share

read it
Adaptive Learning Rates with Maximum Variation Averaging

Adaptive gradient methods such as RMSProp and Adam use exponential movin...
06/21/2020 ∙ by Chen Zhu, et al. ∙ 19 ∙ share

read it
Large-Scale Adversarial Training for Vision-and-Language Representation Learning

We present VILLA, the first known effort on large-scale adversarial trai...
06/11/2020 ∙ by Zhe Gan, et al. ∙ 6 ∙ share

read it
Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models

Recent Transformer-based large-scale pre-trained models have revolutioni...
05/15/2020 ∙ by Jize Cao, et al. ∙ 0 ∙ share

read it
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training

We present HERO, a Hierarchical EncodeR for Omni-representation learning...
05/01/2020 ∙ by Linjie Li, et al. ∙ 3 ∙ share

read it
Contextual Text Style Transfer

We introduce a new task, Contextual Text Style Transfer - translating a ...
04/30/2020 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
APo-VAE: Text Generation in Hyperbolic Space

Natural language often exhibits inherent hierarchical structure ingraine...
04/30/2020 ∙ by Shuyang Dai, et al. ∙ 0 ∙ share

read it
BachGAN: High-Resolution Image Synthesis from Salient Object Layout

We propose a new task towards more practical application for image gener...
03/26/2020 ∙ by Yandong Li, et al. ∙ 7 ∙ share

read it
VIOLIN: A Large-Scale Dataset for Video-and-Language Inference

We introduce a new task, Video-and-Language Inference, for joint multimo...
03/25/2020 ∙ by Jingzhou Liu, et al. ∙ 17 ∙ share

read it
Self-Guided Adaptation: Progressive Representation Alignment for Domain Adaptive Object Detection

Unsupervised domain adaptation (UDA) has achieved unprecedented success ...
03/19/2020 ∙ by Zongxian Li, et al. ∙ 0 ∙ share

read it
Multi-level Head-wise Match and Aggregation in Transformer for Textual Sequence Matching

Transformer has been successfully applied to many natural language proce...
01/20/2020 ∙ by Shuohang Wang, et al. ∙ 0 ∙ share

read it
Distilling the Knowledge of BERT for Text Generation

Large-scale pre-trained language model, such as BERT, has recently achie...
11/10/2019 ∙ by Yen-Chun Chen, et al. ∙ 0 ∙ share

read it
Hierarchical Graph Network for Multi-hop Question Answering

In this paper, we present Hierarchical Graph Network (HGN) for multi-hop...
11/09/2019 ∙ by Yuwei Fang, et al. ∙ 0 ∙ share

read it
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation

We present a large, tunable neural conversational response generation mo...
11/01/2019 ∙ by Yizhe Zhang, et al. ∙ 0 ∙ share

read it
Discourse-Aware Neural Extractive Model for Text Summarization

Recently BERT has been adopted in state-of-the-art text summarization mo...
10/30/2019 ∙ by Jiacheng Xu, et al. ∙ 0 ∙ share

read it
Meta Module Network for Compositional Visual Reasoning

There are two main lines of research on visual reasoning: neural module ...
10/08/2019 ∙ by Wenhu Chen, et al. ∙ 0 ∙ share

read it
FreeLB: Enhanced Adversarial Training for Language Understanding

Adversarial training, which minimizes the maximal risk for label-preserv...
09/25/2019 ∙ by Chen Zhu, et al. ∙ 0 ∙ share

read it
UNITER: Learning UNiversal Image-TExt Representations

Joint image-text embedding is the bedrock for most Vision-and-Language (...
09/25/2019 ∙ by Yen-Chun Chen, et al. ∙ 0 ∙ share

read it
What Makes A Good Story? Designing Composite Rewards for Visual Storytelling

Previous storytelling approaches mostly focused on optimizing traditiona...
09/11/2019 ∙ by Junjie Hu, et al. ∙ 0 ∙ share

read it
Contrastively Smoothed Class Alignment for Unsupervised Domain Adaptation

Recent unsupervised approaches to domain adaptation primarily focus on m...
09/11/2019 ∙ by Shuyang Dai, et al. ∙ 0 ∙ share

read it
Patient Knowledge Distillation for BERT Model Compression

Pre-trained language models such as BERT have proven to be highly effect...
08/25/2019 ∙ by Siqi Sun, et al. ∙ 0 ∙ share

read it
Adversarial Domain Adaptation for Machine Reading Comprehension

In this paper, we focus on unsupervised domain adaptation for Machine Re...
08/24/2019 ∙ by Huazheng Wang, et al. ∙ 0 ∙ share

read it
A Hybrid Retrieval-Generation Neural Conversation Model

Intelligent personal assistant systems, with either text-based or voice-...
04/19/2019 ∙ by Liu Yang, et al. ∙ 0 ∙ share

read it
Unsupervised Deep Structured Semantic Models for Commonsense Reasoning

Commonsense reasoning is fundamental to natural language understanding. ...
04/03/2019 ∙ by Shuohang Wang, et al. ∙ 0 ∙ share

read it
Relation-aware Graph Attention Network for Visual Question Answering

In order to answer semantically-complicated questions about an image, a ...
03/29/2019 ∙ by Linjie Li, et al. ∙ 0 ∙ share

read it
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation

We present FAST NAVIGATOR, a general framework for action decoding, whic...
03/06/2019 ∙ by Liyiming Ke, et al. ∙ 6 ∙ share

read it
Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog

This paper presents Recurrent Dual Attention Network (ReDAN) for visual ...
02/01/2019 ∙ by Zhe Gan, et al. ∙ 0 ∙ share

read it
Sequential Attention GAN for Interactive Image Editing via Dialogue

In this paper, we introduce a new task - interactive image editing via c...
12/20/2018 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
StoryGAN: A Sequential Conditional GAN for Story Visualization

In this work we propose a new task called Story Visualization. Given a m...
12/06/2018 ∙ by Yitong Li, et al. ∙ 0 ∙ share

read it
Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning

Training task-completion dialogue agents with reinforcement learning usu...
11/19/2018 ∙ by Yuexin Wu, et al. ∙ 0 ∙ share

read it
ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehension

We present a large-scale dataset, ReCoRD, for machine reading comprehens...
10/30/2018 ∙ by Sheng Zhang, et al. ∙ 0 ∙ share

read it
A Training-based Identification Approach to VIN Adversarial Examples

With the rapid development of Artificial Intelligence (AI), the problem ...
10/18/2018 ∙ by Yingdi Wang, et al. ∙ 0 ∙ share

read it
Multi-Task Learning for Machine Reading Comprehension

We propose a multi-task learning framework to jointly train a Machine Re...
09/18/2018 ∙ by Yichong Xu, et al. ∙ 0 ∙ share

read it
Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning

This paper presents a Discriminative Deep Dyna-Q (D3Q) approach to impro...
08/28/2018 ∙ by Shang-Yu Su, et al. ∙ 0 ∙ share

read it
Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems

This proposal introduces a Dialogue Challenge for building end-to-end ta...
07/29/2018 ∙ by Xiujun Li, et al. ∙ 0 ∙ share

read it
Integrating planning for task-completion dialogue policy learning

Training a task-completion dialogue agent with real users via reinforcem...
01/18/2018 ∙ by Baolin Peng, et al. ∙ 0 ∙ share

read it
Language-Based Image Editing with Recurrent Attentive Models

We investigate the problem of Language-Based Image Editing (LBIE) in thi...
11/16/2017 ∙ by Jianbo Chen, et al. ∙ 0 ∙ share

read it
Towards Human-level Machine Reading Comprehension: Reasoning and Inference with Multiple Strategies

This paper presents a new MRC model that is capable of three key compreh...
11/14/2017 ∙ by Yichong Xu, et al. ∙ 0 ∙ share

read it
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning

This paper presents a new method --- adversarial advantage actor-critic ...
10/31/2017 ∙ by Baolin Peng, et al. ∙ 0 ∙ share

read it

Jingjing Liu

Featured Co-authors