b'Kurt Keutzer'

research

∙ 08/21/2023

QD-BEV : Quantization-aware View-guided Distillation for Multi-view 3D Object Detection

Multi-view 3D detection based on BEV (bird-eye-view) has recently achiev...

0 Yifan Zhang, et al. ∙

research

∙ 07/27/2023

NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detection

We present NeRF-Det, a novel method for indoor 3D detection with posed R...

0 Chenfeng Xu, et al. ∙

research

∙ 06/13/2023

SqueezeLLM: Dense-and-Sparse Quantization

Generative Large Language Models (LLMs) have demonstrated remarkable res...

0 Sehoon Kim, et al. ∙

research

∙ 06/01/2023

Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behavior

Pre-trained machine learning (ML) models have shown great performance fo...

0 Shashank Subramanian, et al. ∙

research

∙ 05/24/2023

Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts

The explosive growth of language models and their applications have led ...

0 Sheng Shen, et al. ∙

research

∙ 04/27/2023

SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detection

By identifying four important components of existing LiDAR-camera 3D obj...

0 Yichen Xie, et al. ∙

research

∙ 04/27/2023

Quadric Representations for LiDAR Odometry, Mapping and Localization

Current LiDAR odometry, mapping and localization methods leverage point-...

0 Chao Xia, et al. ∙

research

∙ 04/03/2023

Open-Vocabulary Point-Cloud Object Detection without 3D Annotation

The goal of open-vocabulary detection is to identify novel objects based...

0 Yuheng Lu, et al. ∙

research

∙ 03/13/2023

Scaling Vision-Language Models with Sparse Mixture of Experts

The field of natural language processing (NLP) has made significant stri...

0 Sheng Shen, et al. ∙

research

∙ 02/27/2023

Full Stack Optimization of Transformer Inference: a Survey

Recent advances in state-of-the-art DNN architecture design have been mo...

0 Sehoon Kim, et al. ∙

research

∙ 02/15/2023

Big Little Transformer Decoder

The recent emergence of Large Language Models based on the Transformer a...

0 Sehoon Kim, et al. ∙

research

∙ 02/08/2023

Q-Diffusion: Quantizing Diffusion Models

Diffusion models have achieved great success in synthesizing diverse and...

0 Xiuyu Li, et al. ∙

research

∙ 12/30/2022

Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning

Remote sensing imagery provides comprehensive views of the Earth, where ...

0 Colorado J. Reed, et al. ∙

research

∙ 12/06/2022

CSQ: Growing Mixed-Precision Quantization Scheme with Bi-level Continuous Sparsification

Mixed-precision quantization has been widely applied on deep neural netw...

0 Lirui Xiao, et al. ∙

research

∙ 11/29/2022

NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers

The complicated architecture and high training cost of vision transforme...

0 Yijiang Liu, et al. ∙

research

∙ 11/21/2022

Multitask Vision-Language Prompt Tuning

Prompt Tuning, conditioning on task-specific learned prompt vectors, has...

0 Sheng Shen, et al. ∙

research

∙ 10/05/2022

Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detection

While recent camera-only 3D detection methods leverage multiple timestep...

0 Jinhyung Park, et al. ∙

research

∙ 09/14/2022

Analysis of Quantization on MLP-based Vision Models

Quantization is wildly taken as a model compression technique, which obt...

0 Lingran Zhao, et al. ∙

research

∙ 09/07/2022

Prior Knowledge-Guided Attention in Self-Supervised Vision Transformers

Recent trends in self-supervised representation learning have focused on...

0 Kevin Miao, et al. ∙

research

∙ 07/05/2022

Open-Vocabulary 3D Detection via Image-level Class and Debiased Cross-modal Contrastive Learning

Current point-cloud detection methods have difficulty detecting the open...

0 Yuheng Lu, et al. ∙

research

∙ 06/22/2022

The ArtBench Dataset: Benchmarking Generative Models with Artworks

We introduce ArtBench-10, the first class-balanced, high-quality, cleanl...

0 Peiyuan Liao, et al. ∙

research

∙ 06/20/2022

Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data

Domain adaptive text classification is a challenging problem for the lar...

0 Tian Li, et al. ∙

research

∙ 06/02/2022

Squeezeformer: An Efficient Transformer for Automatic Speech Recognition

The recently proposed Conformer model has become the de facto backbone m...

29 Sehoon Kim, et al. ∙

research

∙ 04/21/2022

PreTraM: Self-Supervised Pre-training via Connecting Trajectory and Map

Deep learning has recently achieved significant progress in trajectory f...

0 Chenfeng Xu, et al. ∙

research

∙ 04/20/2022

K-LITE: Learning Transferable Visual Models with External Knowledge

Recent state-of-the-art computer vision systems are trained from natural...

3 Sheng Shen, et al. ∙

research

∙ 03/11/2022

Staged Training for Transformer Language Models

The current standard approach to scaling transformer language models tra...

8 Sheng Shen, et al. ∙

research

∙ 10/25/2021

Differentiable NAS Framework and Application to Ads CTR Prediction

Neural architecture search (NAS) methods aim to automatically find the o...

11 Ravi Krishna, et al. ∙

research

∙ 09/25/2021

Multi-source Few-shot Domain Adaptation

Multi-source Domain Adaptation (MDA) aims to transfer predictive models ...

0 Xiangyu Yue, et al. ∙

research

∙ 09/08/2021

What's Hidden in a One-layer Randomly Weighted Transformer?

We demonstrate that, hidden within one-layer randomly weighted neural ne...

17 Sheng Shen, et al. ∙

research

∙ 08/18/2021

Emotion Recognition from Multiple Modalities: Fundamentals and Methodologies

Humans are emotional creatures. Multiple modalities are often involved w...

0 Sicheng Zhao, et al. ∙

research

∙ 07/13/2021

How Much Can CLIP Benefit Vision-and-Language Tasks?

Most existing Vision-and-Language (V L) models rely on pre-trained vis...

7 Sheng Shen, et al. ∙

research

∙ 07/03/2021

Scene-aware Learning Network for Radar Object Detection

Object detection is essential to safe autonomous or assisted driving. Pr...

0 Zangwei Zheng, et al. ∙

research

∙ 07/02/2021

Learned Token Pruning for Transformers

A major challenge in deploying transformer models is their prohibitive i...

8 Sehoon Kim, et al. ∙

research

∙ 06/30/2021

Affective Image Content Analysis: Two Decades Review and New Perspectives

Images can convey rich semantics and induce various emotions in viewers....

0 Sicheng Zhao, et al. ∙

research

∙ 06/11/2021

Invariant Information Bottleneck for Domain Generalization

The main challenge for domain generalization (DG) is to overcome the pot...

0 Bo Li, et al. ∙

research

∙ 06/08/2021

Image2Point: 3D Point-Cloud Understanding with Pretrained 2D ConvNets

3D point-clouds and 2D images are different visual representations of th...

4 Chenfeng Xu, et al. ∙

research

∙ 05/30/2021

MLPruning: A Multilevel Structured Pruning Framework for Transformer-based Models

Pruning is an effective method to reduce the memory footprint and comput...

21 Zhewei Yao, et al. ∙

research

∙ 04/26/2021

HAO: Hardware-aware neural Architecture Optimization for Efficient Inference

Automatic algorithm-hardware co-design for DNN has shown great success i...

21 Zhen Dong, et al. ∙

research

∙ 03/31/2021

Q-ASR: Integer-only Zero-shot Quantization for Efficient Speech Recognition

End-to-end neural network models achieve improved performance on various...

0 Sehoon Kim, et al. ∙

research

∙ 03/25/2021

A Survey of Quantization Methods for Efficient Neural Network Inference

As soon as abstract mathematical computations were adapted to computatio...

10 Amir Gholami, et al. ∙

research

∙ 03/23/2021

Self-Supervised Pretraining Improves Self-Supervised Pretraining

While self-supervised pretraining has proven beneficial for many compute...

45 Colorado J. Reed, et al. ∙

research

∙ 03/18/2021

You Only Group Once: Efficient Point-Cloud Processing with Token Representation and Relation Inference Module

3D point-cloud-based perception is a challenging but crucial computer vi...

0 Chenfeng Xu, et al. ∙

research

∙ 01/22/2021

Hessian-Aware Pruning and Optimal Neural Implant

Pruning is an effective method to reduce the memory footprint and FLOPs ...

1 Shixing Yu, et al. ∙

research

∙ 01/05/2021

I-BERT: Integer-only BERT Quantization

Transformer based models, like BERT and RoBERTa, have achieved state-of-...

0 Sehoon Kim, et al. ∙

research

∙ 12/30/2020

Reservoir Transformer

We demonstrate that transformers obtain impressive performance even when...

23 Sheng Shen, et al. ∙

research

∙ 12/05/2020

Cross-Domain Sentiment Classification with In-Domain Contrastive Learning

Contrastive learning (CL) has been successful as a powerful representati...

0 Tian Li, et al. ∙

research

∙ 11/30/2020

Annotation-Efficient Untrimmed Video Action Recognition

Deep learning has achieved great success in recognizing video actions, b...

0 Yixiong Zou, et al. ∙

research

∙ 11/25/2020

FBWave: Efficient and Scalable Neural Vocoders for Streaming Text-To-Speech on the Edge

Nowadays more and more applications can benefit from edge-based text-to-...

0 Bichen Wu, et al. ∙

research

∙ 11/25/2020

Emotional Semantics-Preserved and Feature-Aligned CycleGAN for Visual Emotion Adaptation

Thanks to large-scale labeled training data, deep neural networks (DNNs)...

7 Sicheng Zhao, et al. ∙

research

∙ 11/20/2020

HAWQV3: Dyadic Neural Network Quantization

Quantization is one of the key techniques used to make Neural Networks (...

7 Zhewei Yao, et al. ∙

Kurt Keutzer

Featured Co-authors