research
∙
09/18/2023
Unified Coarse-to-Fine Alignment for Video-Text Retrieval
The canonical approach to video-text retrieval leverages a coarse-graine...
share
research
∙
01/19/2023
LoCoNet: Long-Short Context Network for Active Speaker Detection
Active Speaker Detection (ASD) aims to identify who is speaking in each ...
research
∙
12/29/2022
Efficient Movie Scene Detection using State-Space Transformers
The ability to distinguish between different movie scenes is critical fo...
research
∙
12/15/2022
Vision Transformers are Parameter-Efficient Audio-Visual Learners
Vision transformers (ViTs) have achieved impressive results on various c...
research
∙
12/09/2022
VindLU: A Recipe for Effective Video-and-Language Pretraining
The last several years have witnessed remarkable progress in video-and-l...
research
∙
10/20/2022
SimpleClick: Interactive Image Segmentation with Simple Vision Transformers
Click-based interactive image segmentation aims at extracting objects wi...
research
∙
08/24/2022
Improving video retrieval using multilingual knowledge transfer
Video retrieval has seen tremendous progress with the development of vis...
research
∙
07/24/2022
Object State Change Classification in Egocentric Videos using the Divided Space-Time Attention Mechanism
This report describes our submission called "TarHeels" for the Ego4D: Ob...
research
∙
05/11/2022
Learning to Retrieve Videos by Asking Questions
The majority of traditional text-to-video retrieval systems operate in s...
research
∙
04/06/2022
ECLIPSE: Efficient Long-range Video Retrieval using Sight and Sound
We introduce an audiovisual method for long-range text-to-video retrieva...
research
∙
04/04/2022
Long Movie Clip Classification with State-Space Video Models
Most modern video recognition models are designed to operate on short vi...
research
∙
04/04/2022
TALLFormer: Temporal Action Localization with Long-memory Transformer
Most modern approaches in temporal action localization divide this probl...
research
∙
01/26/2022
Learning To Recognize Procedural Activities with Distant Supervision
In this paper we consider the problem of classifying fine-grained, multi...
research
∙
06/17/2021
Long-Short Temporal Contrastive Learning of Video Transformers
Video transformers have recently emerged as a competitive alternative to...
research
∙
02/09/2021
Is Space-Time Attention All You Need for Video Understanding?
We present a convolution-free approach to video classification built exc...
research
∙
01/28/2021
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs
We present Vx2Text, a framework for text generation from multimodal inpu...
research
∙
07/14/2020
COBE: Contextualized Object Embeddings from Narrated Instructional Video
Many objects in the real world undergo dramatic variations in visual app...
research
∙
12/10/2019
Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagation
We introduce a method for simultaneously classifying, segmenting and tra...
research
∙
06/06/2019
Learning Temporal Pose Estimation from Sparsely-Labeled Videos
Modern approaches for multi-person pose estimation in video require larg...
research
∙
04/10/2019
Attentive Action and Context Factorization
We propose a method for human action recognition, one that can localize ...
research
∙
12/11/2018
Learning Discriminative Motion Features Through Detection
Despite huge success in the image domain, modern detection models such a...
research
∙
03/15/2018
Object Detection in Video with Spatiotemporal Sampling Networks
We propose a Spatiotemporal Sampling Network (STSN) that uses deformable...
research
∙
03/04/2018
Egocentric Basketball Motion Planning from a Single First-Person Image
We present a model that uses a single first-person image to generate an ...
research
∙
09/05/2017
Using Cross-Model EgoSupervision to Learn Cooperative Basketball Intention
We present a first-person method for cooperative basketball intention pr...
research
∙
11/16/2016
Am I a Baller? Basketball Performance Assessment from First-Person Videos
This paper presents a method to assess a basketball player's performance...
research
∙
11/16/2016
Unsupervised Learning of Important Objects from First-Person Videos
A first-person camera, placed at a person's head, captures, which object...
research
∙
05/24/2016
Local Perturb-and-MAP for Structured Prediction
Conditional random fields (CRFs) provide a powerful tool for structured ...
research
∙
05/24/2016
Convolutional Random Walk Networks for Semantic Image Segmentation
Most current semantic segmentation methods rely on fully convolutional n...
research
∙
03/15/2016
First Person Action-Object Detection with EgoNet
Unlike traditional third-person cameras mounted on robots, a first-perso...
research
∙
11/09/2015
Exploiting Egocentric Object Prior for 3D Saliency Detection
On a minute-to-minute basis people undergo numerous fluid interactions w...
research
∙
11/09/2015
Semantic Segmentation with Boundary Neural Fields
The state-of-the-art in semantic segmentation is currently represented b...
research
∙
04/23/2015
High-for-Low and Low-for-High: Efficient Boundary Detection from Deep Object Features and its Applications to High-Level Vision
Most of the current boundary detection systems rely exclusively on low-l...
research
∙
12/02/2014