research
∙
09/19/2023
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models
Audio-visual representation learning aims to develop systems with human-...
share
research
∙
06/01/2023
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles
Modern hierarchical vision transformers have added several vision-specif...
research
∙
04/14/2023
DINOv2: Learning Robust Visual Features without Supervision
The recent breakthroughs in natural language processing for model pretra...
research
∙
04/06/2023
Diffusion Models as Masked Autoencoders
There has been a longstanding belief that generation can facilitate a tr...
research
∙
01/05/2023
CiT: Curation in Training for Effective Vision-Language Data
Large vision-language models are generally applicable to many downstream...
research
∙
12/15/2022
MAViL: Masked Audio-Video Learners
We present Masked Audio-Video Learners (MAViL) to train audio-visual rep...
research
∙
07/13/2022
Masked Autoencoders that Listen
This paper studies a simple extension of image-based Masked Autoencoders...
research
∙
03/25/2022
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification
After its sweeping success in vision and language tasks, pure attention-...
research
∙
03/23/2022
On Adversarial Robustness of Large-scale Audio Visual Learning
As audio-visual systems are being deployed for safety-critical tasks suc...
research
∙
09/28/2021
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
We present VideoCLIP, a contrastive approach to pre-train a unified mode...
research
∙
05/20/2021
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding
We present a simplified, task-agnostic multi-modal pre-training approach...
research
∙
03/16/2021
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models
This paper studies zero-shot cross-lingual transfer of vision-language m...
research
∙
11/15/2020
Audio-Visual Event Recognition through the lens of Adversary
As audio/visual classification models are widely deployed for sensitive ...
research
∙
10/06/2020
Support-set bottlenecks for video-text representation learning
The dominant paradigm for learning video-text representations – noise co...
research
∙
08/30/2020
A Survey of Deep Active Learning
Active learning (AL) attempts to maximize the performance gain of the mo...
research
∙
06/01/2020
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions
Deep learning has made major breakthroughs and progress in many fields. ...
research
∙
05/06/2020
Unsupervised Multimodal Neural Machine Translation with Pseudo Visual Pivoting
Unsupervised machine translation (MT) has recently achieved impressive r...
research
∙
09/30/2019
Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations
With the aim of promoting and understanding the multilingual version of ...
research
∙
08/12/2019
RWR-GAE: Random Walk Regularization for Graph Auto Encoders
Node embeddings have become an ubiquitous technique for representing gra...
research
∙
07/05/2017