research
∙
07/24/2023
Multiscale Video Pretraining for Long-Term Activity Forecasting
Long-term activity forecasting is an especially challenging research pro...
share
research
∙
06/06/2023
Learning to Ground Instructional Articles in Videos through Narrations
In this paper we present an approach for localizing steps of procedural ...
research
∙
03/09/2023
Open-world Instance Segmentation: Top-down Learning with Bottom-up Supervision
Many top-down architectures for instance segmentation achieve significan...
research
∙
02/16/2023
MINOTAUR: Multi-task Video Grounding From Multimodal Queries
Video understanding tasks take many forms, from action detection to visu...
research
∙
02/03/2023
Egocentric Video Task Translation @ Ego4D Challenge 2022
This technical report describes the EgoTask Translation approach that ex...
research
∙
01/05/2023
HierVL: Learning Hierarchical Video-Language Embeddings
Video-language embeddings are a promising avenue for injecting semantics...
research
∙
01/05/2023
What You Say Is What You Show: Visual Narration Detection in Instructional Videos
Narrated "how-to" videos have emerged as a promising data source for a w...
research
∙
01/03/2023
Ego-Only: Egocentric Action Detection without Exocentric Pretraining
We present Ego-Only, the first training pipeline that enables state-of-t...
research
∙
12/13/2022
Egocentric Video Task Translation
Different video understanding tasks are typically treated in isolation, ...
research
∙
09/13/2022
HistoPerm: A Permutation-Based View Generation Approach for Learning Histopathologic Feature Representations
Recently, deep learning methods have been successfully applied to solve ...
research
∙
03/31/2022
Deformable Video Transformer
Video transformers have recently emerged as an effective alternative to ...
research
∙
01/28/2022
Calibrating Histopathology Image Classifiers using Label Smoothing
The classification of histopathology images fundamentally differs from t...
research
∙
01/26/2022
Learning To Recognize Procedural Activities with Distant Supervision
In this paper we consider the problem of classifying fine-grained, multi...
research
∙
12/06/2021
Label Hallucination for Few-Shot Classification
Few-shot classification requires adapting knowledge learned from a large...
research
∙
06/17/2021
Long-Short Temporal Contrastive Learning of Video Transformers
Video transformers have recently emerged as a competitive alternative to...
research
∙
04/02/2021
Beyond Short Clips: End-to-End Video-Level Learning with Collaborative Memories
The standard way of training video models entails sampling at each itera...
research
∙
02/11/2021
A Multi-View Approach To Audio-Visual Speaker Verification
Although speaker verification has conventionally been an audio-only task...
research
∙
02/09/2021
Is Space-Time Attention All You Need for Video Understanding?
We present a convolution-free approach to video classification built exc...
research
∙
01/29/2021
A Petri Dish for Histopathology Image Analysis
With the rise of deep learning, there has been increased interest in usi...
research
∙
01/28/2021
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs
We present Vx2Text, a framework for text generation from multimodal inpu...
research
∙
01/16/2021
Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks
In contrast to traditional weight optimization in a continuous space, we...
research
∙
01/11/2021
Resolution-Based Distillation for Efficient Histology Image Classification
Developing deep learning models to analyze histology images has been com...
research
∙
09/29/2020
Learn like a Pathologist: Curriculum Learning by Annotator Agreement for Histopathology Image Classification
Applying curriculum learning requires both a range of difficulty in data...
research
∙
07/14/2020
COBE: Contextualized Object Embeddings from Narrated Instructional Video
Many objects in the real world undergo dramatic variations in visual app...
research
∙
07/09/2020
Generalized Many-Way Few-Shot Video Classification
Few-shot learning methods operate in low data regimes. The aim is to lea...
research
∙
06/12/2020
Video Understanding as Machine Translation
With the advent of large-scale multimodal video datasets, especially seq...
research
∙
03/01/2020
Stein Variational Inference for Discrete Distributions
Gradient-based approximate inference methods, such as Stein variational ...
research
∙
12/10/2019
Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagation
We introduce a method for simultaneously classifying, segmenting and tra...
research
∙
12/10/2019
Listen to Look: Action Recognition by Previewing Audio
In the face of the video data deluge, today's expensive clip-level class...
research
∙
11/28/2019
Self-Supervised Learning by Cross-Modal Audio-Video Clustering
The visual and audio modalities are highly correlated yet they contain d...
research
∙
07/19/2019
Only Time Can Tell: Discovering Temporal Data for Temporal Modeling
Understanding temporal information and how the visual world changes over...
research
∙
06/10/2019
UniDual: A Unified Model for Image and Video Understanding
Although a video is effectively a sequence of images, visual perception ...
research
∙
06/07/2019
Video Modeling with Correlation Networks
Motion is a salient cue to recognize actions in video. Modern action rec...
research
∙
06/06/2019
Learning Temporal Pose Estimation from Sparsely-Labeled Videos
Modern approaches for multi-person pose estimation in video require larg...
research
∙
04/10/2019
Attentive Action and Context Factorization
We propose a method for human action recognition, one that can localize ...
research
∙
04/08/2019
SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition
While many action recognition datasets consist of collections of brief, ...
research
∙
04/04/2019
Video Classification with Channel-Separated Convolutional Networks
Group convolution has been shown to offer great computational savings in...
research
∙
01/26/2019
DistInit: Learning Video Representations without a Single Labeled Video
Video recognition models have progressed significantly over the past few...
research
∙
12/11/2018
Learning Discriminative Motion Features Through Detection
Despite huge success in the image domain, modern detection models such a...
research
∙
07/28/2018
MaskConnect: Connectivity Learning by Gradient Descent
Although deep networks have recently emerged as the model of choice for ...
research
∙
06/30/2018
Co-Training of Audio and Video Representations from Self-Supervised Temporal Synchronization
There is a natural correlation between the visual and auditive elements ...
research
∙
03/15/2018
Object Detection in Video with Spatiotemporal Sampling Networks
We propose a Spatiotemporal Sampling Network (STSN) that uses deformable...
research
∙
12/26/2017
SLAC: A Sparsely Labeled Dataset for Action Classification and Localization
This paper describes a procedure for the creation of large-scale video d...
research
∙
12/26/2017
Detect-and-Track: Efficient Pose Estimation in Videos
This paper addresses the problem of estimating and tracking human body k...
research
∙
11/30/2017
A Closer Look at Spatiotemporal Convolutions for Action Recognition
In this paper we discuss several forms of spatiotemporal convolutions fo...
research
∙
09/27/2017
Connectivity Learning in Multi-Branch Networks
While much of the work in the design of convolutional networks over the ...
research
∙
09/26/2017
Learning to Inpaint for Image Compression
We study the design of deep architectures for lossy image compression. W...
research
∙
03/05/2017
Deep-Learning for Classification of Colorectal Polyps on Whole-Slide Images
Histopathological characterization of colorectal polyps is an important ...
research
∙
06/23/2016
VideoMCC: a New Benchmark for Video Comprehension
While there is overall agreement that future technology for organizing, ...
research
∙
06/20/2016