b'Yu Cheng'

EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets

Deep, heavily overparameterized language models such as BERT, XLNet and ...
12/31/2020 ∙ by Xiaohan Chen, et al. ∙ 0 ∙ share

read it
Fair for All: Best-effort Fairness Guarantees for Classification

Standard approaches to group-based notions of fairness, such as parity a...
12/18/2020 ∙ by Anilesh K. Krishnaswamy, et al. ∙ 0 ∙ share

read it
DSAM: A Distance Shrinking with Angular Marginalizing Loss for High Performance Vehicle Re-identificatio

Vehicle Re-identification (ReID) is an important yet challenging problem...
11/12/2020 ∙ by Jiangtao Kong, et al. ∙ 0 ∙ share

read it
Object Tracking Using Spatio-Temporal Future Prediction

Occlusion is a long-standing problem that causes many modern tracking me...
10/15/2020 ∙ by Yuan Liu, et al. ∙ 19 ∙ share

read it
Cross-Thought for Sentence Encoder Pre-training

In this paper, we propose Cross-Thought, a novel approach to pre-trainin...
10/07/2020 ∙ by Shuohang Wang, et al. ∙ 0 ∙ share

read it
Multi-Fact Correction in Abstractive Text Summarization

Pre-trained neural abstractive summarization systems have dominated extr...
10/06/2020 ∙ by Yue Dong, et al. ∙ 0 ∙ share

read it
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective

Large-scale language models such as BERT have achieved state-of-the-art ...
10/05/2020 ∙ by Boxin Wang, et al. ∙ 0 ∙ share

read it
Efficient Robust Training via Backward Smoothing

Adversarial training is so far the most effective strategy in defending ...
10/03/2020 ∙ by Jinghui Chen, et al. ∙ 1 ∙ share

read it
Contrastive Distillation on Intermediate Representations for Language Model Compression

Existing language model compression methods mostly use a simple L2 loss ...
09/29/2020 ∙ by Siqi Sun, et al. ∙ 0 ∙ share

read it
Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding

Transformer has become ubiquitous in the deep learning field. One of the...
09/13/2020 ∙ by Shuohang Wang, et al. ∙ 0 ∙ share

read it
Fine-grained Iterative Attention Network for TemporalLanguage Localization in Videos

Temporal language localization in videos aims to ground one video segmen...
08/06/2020 ∙ by Xiaoye Qu, et al. ∙ 0 ∙ share

read it
Graph Optimal Transport for Cross-Domain Alignment

Cross-domain alignment between two sets of entities (e.g., objects in an...
06/26/2020 ∙ by Liqun Chen, et al. ∙ 9 ∙ share

read it
Adaptive Learning Rates with Maximum Variation Averaging

Adaptive gradient methods such as RMSProp and Adam use exponential movin...
06/21/2020 ∙ by Chen Zhu, et al. ∙ 19 ∙ share

read it
Large-Scale Adversarial Training for Vision-and-Language Representation Learning

We present VILLA, the first known effort on large-scale adversarial trai...
06/11/2020 ∙ by Zhe Gan, et al. ∙ 6 ∙ share

read it
Sparsification of Balanced Directed Graphs

Sparsification, where the cut values of an input graph are approximately...
06/02/2020 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models

Recent Transformer-based large-scale pre-trained models have revolutioni...
05/15/2020 ∙ by Jize Cao, et al. ∙ 0 ∙ share

read it
Low-shot Object Detection via Classification Refinement

This work aims to address the problem of low-shot object detection, wher...
05/06/2020 ∙ by Yiting Li, et al. ∙ 2 ∙ share

read it
High-Dimensional Robust Mean Estimation via Gradient Descent

We study the problem of high-dimensional robust mean estimation in the p...
05/04/2020 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training

We present HERO, a Hierarchical EncodeR for Omni-representation learning...
05/01/2020 ∙ by Linjie Li, et al. ∙ 3 ∙ share

read it
Contextual Text Style Transfer

We introduce a new task, Contextual Text Style Transfer - translating a ...
04/30/2020 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
APo-VAE: Text Generation in Hyperbolic Space

Natural language often exhibits inherent hierarchical structure ingraine...
04/30/2020 ∙ by Shuyang Dai, et al. ∙ 0 ∙ share

read it
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning

Pretrained models from self-supervision are prevalently used in fine-tun...
03/28/2020 ∙ by Tianlong Chen, et al. ∙ 11 ∙ share

read it
BachGAN: High-Resolution Image Synthesis from Salient Object Layout

We propose a new task towards more practical application for image gener...
03/26/2020 ∙ by Yandong Li, et al. ∙ 7 ∙ share

read it
VIOLIN: A Large-Scale Dataset for Video-and-Language Inference

We introduce a new task, Video-and-Language Inference, for joint multimo...
03/25/2020 ∙ by Jingzhou Liu, et al. ∙ 17 ∙ share

read it
Optimizing Non-Orthogonal Multiple Access in Random Access Networks

Non-orthogonal multiple access (NOMA) has been considered as a promising...
02/14/2020 ∙ by Ziru Chen, et al. ∙ 0 ∙ share

read it
Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV based Random Access IoT Networks with NOMA

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) techni...
01/31/2020 ∙ by Sami Khairy, et al. ∙ 0 ∙ share

read it
Investigation of Numerical Dispersion with Time Step of The FDTD Methods: Avoiding Erroneous Conclusions

It is widely thought that small time steps lead to small numerical error...
01/29/2020 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
Topology Aware Deep Learning for Wireless Network Optimization

Data-driven machine learning approaches have recently been proposed to f...
12/18/2019 ∙ by Shuai Zhang, et al. ∙ 0 ∙ share

read it
Bridging Disentanglement with Independence and Conditional Independence via Mutual Information for Representation Learning

Existing works on disentangled representation learning usually lie on a ...
11/25/2019 ∙ by Xiaojiang Yang, et al. ∙ 12 ∙ share

read it
INSET: Sentence Infilling with Inter-sentential Generative Pre-training

Missing sentence generation (or sentence infilling) fosters a wide range...
11/10/2019 ∙ by Yichen Huang, et al. ∙ 0 ∙ share

read it
Distilling the Knowledge of BERT for Text Generation

Large-scale pre-trained language model, such as BERT, has recently achie...
11/10/2019 ∙ by Yen-Chun Chen, et al. ∙ 0 ∙ share

read it
Discourse-Aware Neural Extractive Model for Text Summarization

Recently BERT has been adopted in state-of-the-art text summarization mo...
10/30/2019 ∙ by Jiacheng Xu, et al. ∙ 0 ∙ share

read it
Tell-the-difference: Fine-grained Visual Descriptor via a Discriminating Referee

In this paper, we investigate a novel problem of telling the difference ...
10/14/2019 ∙ by Shuangjie Xu, et al. ∙ 0 ∙ share

read it
Meta Module Network for Compositional Visual Reasoning

There are two main lines of research on visual reasoning: neural module ...
10/08/2019 ∙ by Wenhu Chen, et al. ∙ 0 ∙ share

read it
FreeLB: Enhanced Adversarial Training for Language Understanding

Adversarial training, which minimizes the maximal risk for label-preserv...
09/25/2019 ∙ by Chen Zhu, et al. ∙ 0 ∙ share

read it
UNITER: Learning UNiversal Image-TExt Representations

Joint image-text embedding is the bedrock for most Vision-and-Language (...
09/25/2019 ∙ by Yen-Chun Chen, et al. ∙ 0 ∙ share

read it
What Makes A Good Story? Designing Composite Rewards for Visual Storytelling

Previous storytelling approaches mostly focused on optimizing traditiona...
09/11/2019 ∙ by Junjie Hu, et al. ∙ 0 ∙ share

read it
Contrastively Smoothed Class Alignment for Unsupervised Domain Adaptation

Recent unsupervised approaches to domain adaptation primarily focus on m...
09/11/2019 ∙ by Shuyang Dai, et al. ∙ 0 ∙ share

read it
Domain Adaptive Text Style Transfer

Text style transfer without parallel data has achieved some practical su...
08/25/2019 ∙ by Dianqi Li, et al. ∙ 0 ∙ share

read it
Patient Knowledge Distillation for BERT Model Compression

Pre-trained language models such as BERT have proven to be highly effect...
08/25/2019 ∙ by Siqi Sun, et al. ∙ 0 ∙ share

read it
Attend To Count: Crowd Counting with Adaptive Capacity Multi-scale CNNs

Crowd counting is a challenging task due to the large variations in crow...
08/07/2019 ∙ by Zhikang Zou, et al. ∙ 4 ∙ share

read it
Mixed-Supervised Dual-Network for Medical Image Segmentation

Deep learning-based medical image segmentation models usually require la...
07/24/2019 ∙ by Duo Wang, et al. ∙ 9 ∙ share

read it
EnlightenGAN: Deep Light Enhancement without Paired Supervision

Deep learning-based methods have achieved remarkable success in image re...
06/17/2019 ∙ by Yifan Jiang, et al. ∙ 26 ∙ share

read it
Faster Algorithms for High-Dimensional Robust Covariance Estimation

We study the problem of estimating the covariance matrix of a high-dimen...
06/11/2019 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
Group Fairness in Committee Selection

In this paper, we study fairness in committee selection problems. We con...
05/11/2019 ∙ by Yu Cheng, et al. ∙ 0 ∙ share

read it
A Hybrid Approach with Optimization and Metric-based Meta-Learner for Few-Shot Learning

Few-shot learning aims to learn classifiers for new classes with only a ...
04/04/2019 ∙ by Duo Wang, et al. ∙ 0 ∙ share

read it
Relation-aware Graph Attention Network for Visual Question Answering

In order to answer semantically-complicated questions about an image, a ...
03/29/2019 ∙ by Linjie Li, et al. ∙ 0 ∙ share

read it
POP-CNN: Predicting Odor's Pleasantness with Convolutional Neural Network

Predicting odor's pleasantness simplifies the evaluation of odors and ha...
03/19/2019 ∙ by Danli Wu, et al. ∙ 0 ∙ share

read it
Measuring Patient Similarities via a Deep Architecture with Medical Concept Embedding

Evaluating the clinical similarities between pairwise patients is a fund...
02/09/2019 ∙ by Zihao Zhu, et al. ∙ 0 ∙ share

read it
Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog

This paper presents Recurrent Dual Attention Network (ReDAN) for visual ...
02/01/2019 ∙ by Zhe Gan, et al. ∙ 0 ∙ share

read it

Yu Cheng

Featured Co-authors