research
∙
05/22/2023
Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Design
Scaling laws have been recently employed to derive compute-optimal model...
share
research
∙
11/17/2022
VeLO: Training Versatile Learned Optimizers by Scaling Up
While deep learning models have replaced hand-designed features across m...
research
∙
05/20/2022
UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes
We introduce UViM, a unified approach capable of modeling a wide range o...
research
∙
05/03/2022
Better plain ViT baselines for ImageNet-1k
It is commonly accepted that the Vision Transformer model requires sophi...
research
∙
06/09/2021
Knowledge distillation: A good teacher is patient and consistent
There is a growing discrepancy in computer vision between large-scale mo...
research
∙
05/04/2021
MLP-Mixer: An all-MLP Architecture for Vision
Convolutional Neural Networks (CNNs) are the go-to model for computer vi...
research
∙
10/22/2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
While the Transformer architecture has become the de-facto standard for ...
research
∙
03/22/2017
