research
∙
06/08/2023
R-MAE: Regions Meet Masked Autoencoders
Vision-specific concepts such as "region" have played a key role in exte...
share
research
∙
06/01/2023
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles
Modern hierarchical vision transformers have added several vision-specif...
research
∙
04/06/2023
Diffusion Models as Masked Autoencoders
There has been a longstanding belief that generation can facilitate a tr...
research
∙
03/13/2023
Efficient Semantic Segmentation by Altering Resolutions for Compressed Videos
Video semantic segmentation (VSS) is a computationally expensive task du...
research
∙
12/15/2022
MAViL: Masked Audio-Video Learners
We present Masked Audio-Video Learners (MAViL) to train audio-visual rep...
research
∙
12/01/2022
Scaling Language-Image Pre-training via Masking
We present Fast Language-Image Pre-training (FLIP), a simple and more ef...
research
∙
11/18/2022
Where is my Wallet? Modeling Object Proposal Sets for Egocentric Visual Query Localization
This paper deals with the problem of localizing objects in image and vid...
research
∙
08/03/2022
Negative Frames Matter in Egocentric Visual Query 2D Localization
The recently released Ego4D dataset and benchmark significantly scales a...
research
∙
05/18/2022
Masked Autoencoders As Spatiotemporal Learners
This paper studies a conceptually simple extension of Masked Autoencoder...
research
∙
03/30/2022
Exploring Plain Vision Transformer Backbones for Object Detection
We explore the plain, non-hierarchical Vision Transformer (ViT) as a bac...
research
∙
01/20/2022
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition
While today's video recognition systems parse snapshots or short clips a...
research
∙
12/02/2021
Improved Multiscale Vision Transformers for Classification and Detection
In this paper, we study Multiscale Vision Transformers (MViT) as a unifi...
research
∙
11/22/2021
Benchmarking Detection Transfer Learning with Vision Transformers
Object detection is a central downstream task used to test if pre-traine...
research
∙
11/18/2021
PyTorchVideo: A Deep Learning Library for Video Understanding
We introduce PyTorchVideo, an open-source deep-learning library that pro...
research
∙
11/11/2021
Masked Autoencoders Are Scalable Vision Learners
This paper shows that masked autoencoders (MAE) are scalable self-superv...
research
∙
04/22/2021
Multiscale Vision Transformers
We present Multiscale Vision Transformers (MViT) for video and image rec...
research
∙
04/16/2021
Ego-Exo: Transferring Visual Representations from Third-person to First-person Videos
We introduce an approach for pre-training egocentric video models using ...
research
∙
01/31/2020
Modality Compensation Network: Cross-Modal Adaptation for Action Recognition
With the prevalence of RGB-D cameras, multi-modal video data have become...
research
∙
01/14/2020
EGO-TOPO: Environment Affordances from Egocentric Video
First-person video naturally brings the use of a physical environment to...
research
∙
03/14/2019
SimpleDet: A Simple and Versatile Distributed Framework for Object Detection and Instance Recognition
Object detection and instance recognition play a central role in many AI...
research
∙
01/07/2019
Scale-Aware Trident Networks for Object Detection
Scale variation is one of the key challenges in object detection. In thi...
research
∙
11/25/2018
Temporal Bilinear Networks for Video Action Recognition
Temporal modeling in videos is a fundamental yet challenging problem in ...
research
∙
03/22/2017
PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understanding
Despite the fact that many 3D human activity benchmarks being proposed, ...
research
∙
01/04/2017
Demystifying Neural Style Transfer
Neural Style Transfer has recently demonstrated very exciting results wh...
research
∙
11/17/2016
Factorized Bilinear Models for Image Recognition
Although Deep Convolutional Neural Networks (CNNs) have liberated their ...
research
∙
04/19/2016
Online Human Action Detection using Joint Classification-Regression Recurrent Neural Networks
Human action recognition from well-segmented 3D skeleton data has been i...
research
∙
03/24/2016
Co-occurrence Feature Learning for Skeleton based Action Recognition using Regularized Deep LSTM Networks
Skeleton based action recognition distinguishes human actions using the ...
research
∙
03/15/2016