University of Amsterdam and Renmin University at TRECVID 2017: Searching Video, Detecting Events and Describing Video

01/15/2020
by   Noureldien Hussein, et al.
0

In this paper, we summarize our TRECVID 2017 video recognition and retrieval experiments. We participated in three tasks: video search, event detection and video description. For both video search and event detection, we explore semantic representations based on VideoStory and an ImageNet Shuffle, which thrive well in few-example regimes. For the video description task, we experiment with a deep network that predicts a visual representation from a natural language description with Word2VisualVec, and use this space for the sentence matching. For generative description we enhance a neural image captioning model with Early Embedding and Late Reranking. The 2017 edition of the TRECVID benchmark has been a fruitful participation for our joint-team, resulting in the best overall result for video search and event detection as well as the runner-up position for video description.

READ FULL TEXT

page 3

page 4

research
08/08/2016

Learning Joint Representations of Videos and Sentences with Web Image Search

Our objective is video retrieval based on natural language queries. In a...
research
04/23/2018

Jointly Localizing and Describing Events for Dense Video Captioning

Automatically describing a video with natural language is regarded as a ...
research
09/18/2023

Specification-Driven Video Search via Foundation Models and Formal Verification

The increasing abundance of video data enables users to search for event...
research
09/21/2020

TRECVID 2019: An Evaluation Campaign to Benchmark Video Activity Detection, Video Captioning and Matching, and Video Search Retrieval

The TREC Video Retrieval Evaluation (TRECVID) 2019 was a TREC-style vide...
research
06/23/2016

VideoMCC: a New Benchmark for Video Comprehension

While there is overall agreement that future technology for organizing, ...
research
10/10/2015

TagBook: A Semantic Video Representation without Supervision for Event Detection

We consider the problem of event detection in video for scenarios where ...
research
08/11/2018

Target Image Video Search Based on Local Features

This paper presents a new search algorithm called Target Image Search ba...

Please sign up or login with your details

Forgot password? Click here to reset