Zechun Liu | DeepAI

DeepAI AI Chat

Featured Co-authors

Wei Liu
352 publications
Zhangyang Wang
226 publications
Trevor Darrell
202 publications
Jian Sun
177 publications
Chi Zhang
162 publications
Xin Yang
142 publications
Xiangyu Zhang
140 publications
Meng Li
75 publications
Tianlong Chen
75 publications
Eric Xing
67 publications
Baoyuan Wu
60 publications

∙ 05/29/2023

LLM-QAT: Data-Free Quantization Aware Training for Large Language Models

Several post-training quantization methods have been applied to large la...

0 Zechun Liu, et al. ∙

∙ 03/22/2023

EBSR: Enhanced Binary Neural Network for Image Super-Resolution

While the performance of deep convolutional neural networks for image su...

0 Renjie Wei, et al. ∙

∙ 02/04/2023

Oscillation-free Quantization for Low-bit Vision Transformers

Weight oscillation is an undesirable side effect of quantization-aware t...

0 Shih-Yang Liu, et al. ∙

∙ 05/25/2022

BiT: Robustly Binarized Multi-distilled Transformer

Modern pre-trained transformers have rapidly advanced the state-of-the-a...

0 Zechun Liu, et al. ∙

∙ 01/03/2022

Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space

This paper explores the feasibility of finding an optimal sub-model from...

17 Arnav Chavan, et al. ∙

∙ 12/03/2021

Data-Free Neural Architecture Search via Recursive Label Calibration

This paper aims to explore the feasibility of neural architecture search...

1 Zechun Liu, et al. ∙

∙ 11/29/2021

Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation

The nonuniform quantization strategy for compressing neural networks usu...

11 Zechun Liu, et al. ∙

∙ 11/09/2021

Sliced Recursive Transformer

We present a neat yet effective recursive operation on vision transforme...

7 Zhiqiang Shen, et al. ∙

∙ 06/21/2021

How Do Adam and Training Strategies Help BNNs Optimization?

The best performing Binary Neural Networks (BNNs) are usually attained u...

1 Zechun Liu, et al. ∙

∙ 04/16/2021

"BNN - BN = ?": Training Binary Neural Networks without Batch Normalization

Batch normalization (BN) is a key facilitator and considered essential f...

0 Tianlong Chen, et al. ∙

∙ 04/01/2021

Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study

This work aims to empirically clarify a recently discovered perspective ...

0 Zhiqiang Shen, et al. ∙

∙ 02/17/2021

S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration

Previous studies dominantly target at self-supervised learning on real-v...

0 Zhiqiang Shen, et al. ∙

∙ 02/08/2021

Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learning

The goal of few-shot learning is to learn a classifier that can recogniz...

0 Zhiqiang Shen, et al. ∙

∙ 11/29/2020

Conditional Link Prediction of Category-Implicit Keypoint Detection

Keypoints of objects reflect their concise abstractions, while the corre...

0 Ellen Yi-Ge, et al. ∙

∙ 07/04/2020

Weight-dependent Gates for Network Pruning

In this paper, we propose a simple and effective network pruning framewo...

1 Yun Li, et al. ∙

∙ 05/18/2020

Joint Multi-Dimension Pruning

We present joint multi-dimension pruning (named as JointPruning), a new ...

6 Zechun Liu, et al. ∙

∙ 05/13/2020

Binarizing MobileNet via Evolution-based Searching

Binary Neural Networks (BNNs), known to be one among the effectively com...

0 Hai Phan, et al. ∙

∙ 03/29/2020

Attentive CutMix: An Enhanced Data Augmentation Approach for Deep Learning Based Image Classification

Convolutional neural networks (CNN) are capable of learning robust repre...

0 Devesh Walawalkar, et al. ∙

∙ 03/11/2020

Rethinking Image Mixture for Unsupervised Visual Representation Learning

In supervised learning, smoothing label/prediction distribution in neura...

8 Zhiqiang Shen, et al. ∙

∙ 03/07/2020

ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions

In this paper, we propose several ideas for enhancing a binary network t...

0 Zechun Liu, et al. ∙

∙ 06/05/2019

Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization

Optimization of Binarized Neural Networks (BNNs) currently relies on rea...

0 Koen Helwegen, et al. ∙

∙ 03/31/2019

Single Path One-Shot Neural Architecture Search with Uniform Sampling

One-shot method is a powerful Neural Architecture Search (NAS) framework...

0 Zichao Guo, et al. ∙

∙ 03/25/2019

MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning

In this paper, we propose a novel meta learning approach for automatic c...

0 Zechun Liu, et al. ∙

∙ 11/04/2018

Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance

In this paper, we study 1-bit convolutional neural networks (CNNs), of w...

0 Zechun Liu, et al. ∙

∙ 08/01/2018

Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithm

In this work, we study the 1-bit convolutional neural networks (CNNs), o...

0 Zechun Liu, et al. ∙