research
∙
05/27/2023
Non-Sequential Graph Script Induction via Multimedia Grounding
Online resources such as WikiHow compile a wide range of scripts for per...
share
research
∙
04/07/2023
Language Models are Causal Knowledge Extractors for Zero-shot Video Question Answering
Causal Video Question Answering (CVidQA) queries not only association or...
research
∙
03/25/2023
Supervised Masked Knowledge Distillation for Few-Shot Transformers
Vision Transformers (ViTs) emerge to achieve impressive performance on m...
research
∙
01/06/2023
In Defense of Structural Symbolic Representation for Video Event-Relation Prediction
Understanding event relationships in videos requires a model to understa...
research
∙
11/03/2022
Video Event Extraction via Tracking Visual States of Arguments
Video event extraction aims to detect salient events from a video and id...
research
∙
10/22/2022
Weakly-Supervised Temporal Article Grounding
Given a long untrimmed video and natural language queries, video groundi...
research
∙
10/09/2022
Learning to Decompose Visual Features with Latent Textual Prompts
Recent advances in pre-training vision-language models like CLIP have sh...
research
∙
06/14/2022
Multimodal Event Graphs: Towards Event Centric Understanding of Multimodal World
Understanding how events described or shown in multimedia content relate...
research
∙
06/05/2022
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval
Multi-channel video-language retrieval require models to understand info...
research
∙
05/22/2022
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
The goal of this work is to build flexible video-language models that ca...
research
∙
01/26/2022
Learning To Recognize Procedural Activities with Distant Supervision
In this paper we consider the problem of classifying fine-grained, multi...
research
∙
01/13/2022
CLIP-Event: Connecting Text and Images with Event Structures
Vision-language (V+L) pretraining models have achieved great success in ...
research
∙
12/20/2021
MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding
Recently, there has been an increasing interest in building question ans...
research
∙
09/27/2021
Joint Multimedia Event Extraction from Video and Article
Visual and textual modalities contribute complementary information about...
research
∙
03/23/2021
Co-Grounding Networks with Semantic Attention for Referring Expression Comprehension in Videos
In this paper, we address the problem of referring expression comprehens...
research
∙
01/28/2021
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs
We present Vx2Text, a framework for text generation from multimodal inpu...
research
∙
12/10/2019
Flow-Distilled IP Two-Stream Networks for Compressed Video Action Recognition
Two-stream networks have achieved great success in video recognition. A ...
research
∙
12/10/2019
Flow-Distilled IP Two-Stream Networks for Compressed Video ActionRecognition
Two-stream networks have achieved great success in video recognition. A ...
research
∙
10/24/2019
LPAT: Learning to Predict Adaptive Threshold for Weakly-supervised Temporal Action Localization
Recently, Weakly-supervised Temporal Action Localization (WTAL) has been...
research
∙
10/12/2019
Context-Gated Convolution
As the basic building block of Convolutional Neural Networks (CNNs), the...
research
∙
03/04/2019
Unsupervised Rank-Preserving Hashing for Large-Scale Image Retrieval
We propose an unsupervised hashing method which aims to produce binary c...
research
∙
01/11/2019