b'Jiahui Yu'

research

∙ 06/22/2023

AudioPaLM: A Large Language Model That Can Speak and Listen

We introduce AudioPaLM, a large language model for speech understanding ...

0 Paul K. Rubenstein, et al. ∙

research

∙ 03/31/2023

Practical Conformer: Optimizing size, speed and flops of Conformer for on-Device and cloud ASR

Conformer models maintain a large number of internal states, the vast ma...

0 Rami Botros, et al. ∙

research

∙ 03/24/2023

VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining

Assessing the aesthetics of an image is challenging, as it is influenced...

0 Junjie Ke, et al. ∙

research

∙ 03/23/2023

CoBIT: A Contrastive Bi-directional Image-Text Generation Model

The field of vision and language has witnessed a proliferation of pre-tr...

0 Haoxuan You, et al. ∙

research

∙ 02/08/2023

Noise2Music: Text-conditioned Music Generation with Diffusion Models

We introduce Noise2Music, where a series of diffusion models is trained ...

0 Qingqing Huang, et al. ∙

research

∙ 10/10/2022

Deep object detection for waterbird monitoring using aerial imagery

Monitoring of colonial waterbird nesting islands is essential to trackin...

0 Krish Kabra, et al. ∙

research

∙ 09/02/2022

Normalization effects on deep neural networks

We study the effect of normalization on the layers of deep neural networ...

0 Jiahui Yu, et al. ∙

research

∙ 06/22/2022

Scaling Autoregressive Models for Content-Rich Text-to-Image Generation

We present the Pathways Autoregressive Text-to-Image (Parti) model, whic...

0 Jiahui Yu, et al. ∙

research

∙ 05/04/2022

CoCa: Contrastive Captioners are Image-Text Foundation Models

Exploring large-scale pretrained foundation models is of significant int...

0 Jiahui Yu, et al. ∙

research

∙ 02/03/2022

Self-supervised Learning with Random-projection Quantizer for Speech Recognition

We present a simple and effective self-supervised learning approach for ...

0 Chung-Cheng Chiu, et al. ∙

research

∙ 12/14/2021

Co-training Transformer with Videos and Images Improves Action Recognition

In learning action recognition, models are typically pre-trained on obje...

0 Bowen Zhang, et al. ∙

research

∙ 10/09/2021

Vector-quantized Image Modeling with Improved VQGAN

Pretraining language models with next-token prediction on massive text c...

0 Jiahui Yu, et al. ∙

research

∙ 09/27/2021

BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition

We summarize the results of a host of efforts using giant automatic spee...

1 Yu Zhang, et al. ∙

research

∙ 08/24/2021

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

With recent progress in joint modeling of visual and textual representat...

6 Zirui Wang, et al. ∙

research

∙ 11/21/2020

A Better and Faster End-to-End Model for Streaming ASR

End-to-end (E2E) models have shown to outperform state-of-the-art conven...

0 Bo Li, et al. ∙

research

∙ 11/20/2020

Normalization effects on shallow neural networks and related asymptotic expansions

We consider shallow (single hidden layer) neural networks and characteri...

0 Jiahui Yu, et al. ∙

research

∙ 10/27/2020

Cascaded encoders for unifying streaming and non-streaming ASR

End-to-end (E2E) automatic speech recognition (ASR) models, by now, have...

0 Arun Narayanan, et al. ∙

research

∙ 10/21/2020

FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization

Streaming automatic speech recognition (ASR) aims to emit each hypothesi...

5 Jiahui Yu, et al. ∙

research

∙ 10/12/2020

Universal ASR: Unify and Improve Streaming ASR with Full-context Modeling

Streaming automatic speech recognition (ASR) aims to emit each hypothesi...

8 Jiahui Yu, et al. ∙

research

∙ 08/06/2020

Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications

The generative adversarial network (GAN) framework has emerged as a powe...

22 Ming-Yu Liu, et al. ∙

research

∙ 06/26/2020

Cross-Ssupervised Object Detection

After learning a new object category from image-level annotations (with ...

17 Zitian Chen, et al. ∙

research

∙ 06/26/2020

Cross-Supervised Object Detection

After learning a new object category from image-level annotations (with ...

6 Zitian Chen, et al. ∙

research

∙ 06/08/2020

Neural Sparse Representation for Image Restoration

Inspired by the robustness and efficiency of sparse representation in sp...

19 Yuchen Fan, et al. ∙

research

∙ 05/16/2020

Dynamic Sparsity Neural Networks for Automatic Speech Recognition

In automatic speech recognition (ASR), model pruning is a widely adopted...

0 Zhaofeng Wu, et al. ∙

research

∙ 05/16/2020

Conformer: Convolution-augmented Transformer for Speech Recognition

Recently Transformer and Convolution neural network (CNN) based models h...

0 Anmol Gulati, et al. ∙

research

∙ 05/07/2020

ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context

Convolutional neural networks (CNN) have shown promising results for end...

0 Wei Han, et al. ∙

research

∙ 04/28/2020

Pyramid Attention Networks for Image Restoration

Self-similarity refers to the image prior widely used in image restorati...

0 Yiqun Mei, et al. ∙

research

∙ 03/24/2020

BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models

Neural architecture search (NAS) has shown promising results discovering...

6 Jiahui Yu, et al. ∙

research

∙ 12/19/2019

Scale-wise Convolution for Image Restoration

While scale-invariant modeling has substantially boosted the performance...

14 Yuchen Fan, et al. ∙

research

∙ 08/22/2019

Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and Noisy Data Refinement

Generic Image recognition is a fundamental and fairly important visual p...

24 Zhiqiang Shen, et al. ∙

research

∙ 03/27/2019

Network Slimming by Slimmable Networks: Towards One-Shot Architecture Search for Channel Numbers

We study how to set channel numbers in a neural network to achieve bette...

2 Jiahui Yu, et al. ∙

research

∙ 03/12/2019

Universally Slimmable Networks and Improved Training Techniques

Slimmable networks are a family of neural networks that can instantly ad...

6 Jiahui Yu, et al. ∙

research

∙ 01/10/2019

Smoothing Spline Semiparametric Density Models

Density estimation plays a fundamental role in many areas of statistics ...

0 Jian Shi, et al. ∙

research

∙ 12/21/2018

Slimmable Neural Networks

We present a simple and general method to train a single neural network ...

16 Jiahui Yu, et al. ∙

research

∙ 08/27/2018

Wide Activation for Efficient and Accurate Image Super-Resolution

In this report we demonstrate that with same parameters and computationa...

0 Jiahui Yu, et al. ∙

research

∙ 06/18/2018

A Hierarchical Approach to Encrypted Data Packet Classification in Smart Home Gateways

With the pervasive network based services in smart homes, traditional ne...

0 Xuejiao Chen, et al. ∙

research

∙ 06/10/2018

Free-Form Image Inpainting with Gated Convolution

We present a novel deep learning based image inpainting system to comple...

0 Jiahui Yu, et al. ∙

research

∙ 01/24/2018

Generative Image Inpainting with Contextual Attention

Recent deep learning based approaches have shown promising results on im...

0 Jiahui Yu, et al. ∙

research

∙ 08/04/2016

UnitBox: An Advanced Object Detection Network

In present object detection systems, the deep convolutional neural netwo...

0 Jiahui Yu, et al. ∙

Jiahui Yu

Featured Co-authors