research
∙
09/21/2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance
In this paper, we propose a novel cross-modal distillation method, calle...
share
research
∙
08/20/2023
Improving Adversarial Robustness of Masked Autoencoders via Test-time Frequency-domain Prompting
In this paper, we investigate the adversarial robustness of vision trans...
research
∙
06/08/2023
HQ-50K: A Large-scale, High-quality Dataset for Image Restoration
This paper introduces a new large-scale image restoration dataset, calle...
research
∙
06/07/2023
Designing a Better Asymmetric VQGAN for StableDiffusion
StableDiffusion is a revolutionary text-to-image generator that is causi...
research
∙
05/25/2023
Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models
Text-to-Image diffusion models have made tremendous progress over the pa...
research
∙
05/25/2023
Image is First-order Norm+Linear Autoregressive
This paper reveals that every image can be understood as a first-order n...
research
∙
05/23/2023
i-Code Studio: A Configurable and Composable Framework for Integrative AI
Artificial General Intelligence (AGI) requires comprehensive understandi...
research
∙
05/22/2023
Album Storytelling with Iterative Story-aware Captioning and Large Language Models
This work studies how to transform an album to vivid and coherent storie...
research
∙
05/21/2023
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
The convergence of text, visual, and audio data is a key step towards hu...
research
∙
04/27/2023
ChatVideo: A Tracklet-centric Multimodal and Versatile Video Understanding System
Existing deep video models are limited by specific tasks, fixed input-ou...
research
∙
03/21/2023
OmniTracker: Unifying Object Tracking by Tracking-with-Detection
Object tracking (OT) aims to estimate the positions of target objects in...
research
∙
03/15/2023
Cognitive Semantic Communication Systems Driven by Knowledge Graph: Principle, Implementation, and Performance Evaluation
Semantic communication is envisioned as a promising technique to break t...
research
∙
02/27/2023
Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations
Recently, both Contrastive Learning (CL) and Mask Image Modeling (MIM) d...
research
∙
02/19/2023
LC-NeRF: Local Controllable Face Generation in Neural Randiance Field
3D face generation has achieved high visual quality and 3D consistency t...
research
∙
12/21/2022
Generalized Decoding for Pixel, Image, and Language
We present X-Decoder, a generalized decoding model that can predict pixe...
research
∙
12/13/2022
Look Before You Match: Instance Understanding Matters in Video Object Segmentation
Exploring dense matching between the current frame and past frames for l...
research
∙
12/12/2022
CLIP Itself is a Strong Fine-tuner: Achieving 85.7 Accuracy with ViT-B and ViT-L on ImageNet
Recent studies have shown that CLIP has achieved remarkable success in p...
research
∙
12/07/2022
X-Paste: Revisit Copy-Paste at Scale with CLIP and StableDiffusion
Copy-Paste is a simple and effective data augmentation strategy for inst...
research
∙
11/29/2022
Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
This paper focuses on analyzing and improving the commonsense ability of...
research
∙
11/23/2022
Self-Supervised Learning based on Heat Equation
This paper presents a new perspective of self-supervised learning based ...
research
∙
11/22/2022
SinDiffusion: Learning a Diffusion Model from a Single Natural Image
We present SinDiffusion, leveraging denoising diffusion models to captur...
research
∙
09/15/2022
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
This paper presents OmniVL, a new foundation model to support both image...
research
∙
08/29/2022
Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis
Diffusion models (DMs) have shown great potential for high-quality image...
research
∙
08/25/2022
MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretraining
This paper presents a simple yet effective framework MaskCLIP, which inc...
research
∙
07/26/2022
Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-training
Large-scale multi-modal contrastive pre-training has demonstrated great ...
research
∙
07/21/2022
TinyViT: Fast Pretraining Distillation for Small Vision Transformers
Vision transformer (ViT) recently has drawn great attention in computer ...
research
∙
07/14/2022
Bootstrapped Masked Autoencoders for Vision BERT Pretraining
We propose bootstrapped masked autoencoders (BootMAE), a new approach fo...
research
∙
07/07/2022
Should All Proposals be Treated Equally in Object Detection?
The complexity-precision trade-off of an object detector is a critical p...
research
∙
06/30/2022
Semantic Image Synthesis via Diffusion Models
Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkabl...
research
∙
06/12/2022
GLIPv2: Unifying Localization and Vision-Language Understanding
We present GLIPv2, a grounded VL understanding model, that serves both l...
research
∙
06/07/2022
Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding
Leveraging large-scale data can introduce performance gains on many comp...
research
∙
06/03/2022
Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning
People say, "A picture is worth a thousand words". Then how can we get t...
research
∙
06/02/2022
REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
This paper revisits visual representation in knowledge-based visual ques...
research
∙
05/10/2022
Reduce Information Loss in Transformers for Pluralistic Image Inpainting
Transformers have achieved great success in pluralistic image inpainting...
research
∙
05/03/2022
i-Code: An Integrative and Composable Multimodal Learning Framework
Human intelligence is multimodal; we integrate visual, linguistic, and a...
research
∙
04/22/2022
Multimodal Adaptive Distillation for Leveraging Unimodal Encoders for Vision-Language Tasks
Cross-modal encoders for vision-language (VL) tasks are often pretrained...
research
∙
04/20/2022
Residual Mixture of Experts
Mixture of Experts (MoE) is able to scale up vision transformers effecti...
research
∙
04/20/2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Recent state-of-the-art computer vision systems are trained from natural...
research
∙
04/14/2022
MiniViT: Compressing Vision Transformers with Weight Multiplexing
Vision Transformer (ViT) models have recently drawn much attention in co...
research
∙
04/07/2022
DaViT: Dual Attention Vision Transformers
In this work, we introduce Dual Attention Vision Transformers (DaViT), a...
research
∙
04/07/2022
Unified Contrastive Learning in Image-Text-Label Space
Visual recognition is recently learned via either supervised learning on...
research
∙
03/30/2022
Large-Scale Pre-training for Person Re-identification with Noisy Labels
This paper aims to address the problem of pre-training for person re-ide...
research
∙
01/15/2022
CLIP-TD: CLIP Targeted Distillation for Vision-Language Tasks
Contrastive language-image pretraining (CLIP) links vision and language ...
research
∙
01/04/2022
Online Multi-Object Tracking with Unsupervised Re-Identification Learning and Occlusion Estimation
Occlusion between different objects is a typical challenge in Multi-Obje...
research
∙
12/16/2021
RegionCLIP: Region-based Language-Image Pretraining
Contrastive language-image pretraining (CLIP) using image-text pairs has...
research
∙
12/09/2021
HairCLIP: Design Your Hair by Text and Reference Image
Hair editing is an interesting and challenging problem in computer visio...
research
∙
12/07/2021
Grounded Language-Image Pre-training
This paper presents a grounded language-image pre-training (GLIP) model ...
research
∙
12/06/2021
General Facial Representation Learning in a Visual-Linguistic Manner
How to learn a universal facial representation that boosts all face anal...
research
∙
11/29/2021
Vector Quantized Diffusion Model for Text-to-Image Synthesis
We present the vector quantized diffusion (VQ-Diffusion) model for text-...
research
∙
11/24/2021