TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domains

by   George Awad, et al.

The TREC Video Retrieval Evaluation (TRECVID) is a TREC-style video analysis and retrieval evaluation with the goal of promoting progress in research and development of content-based exploitation and retrieval of information from digital video via open, metrics-based evaluation. Over the last twenty years this effort has yielded a better understanding of how systems can effectively accomplish such processing and how one can reliably benchmark their performance. TRECVID has been funded by NIST (National Institute of Standards and Technology) and other US government agencies. In addition, many organizations and individuals worldwide contribute significant time and effort. TRECVID 2020 represented a continuation of four tasks and the addition of two new tasks. In total, 29 teams from various research organizations worldwide completed one or more of the following six tasks: 1. Ad-hoc Video Search (AVS), 2. Instance Search (INS), 3. Disaster Scene Description and Indexing (DSDI), 4. Video to Text Description (VTT), 5. Activities in Extended Video (ActEV), 6. Video Summarization (VSUM). This paper is an introduction to the evaluation framework, tasks, data, and measures used in the evaluation campaign.



There are no comments yet.


page 5

page 13

page 20

page 23

page 34

page 35

page 38

page 39


TRECVID 2019: An Evaluation Campaign to Benchmark Video Activity Detection, Video Captioning and Matching, and Video Search Retrieval

The TREC Video Retrieval Evaluation (TRECVID) 2019 was a TREC-style vide...

ICDAR 2021 Competition on Scene Video Text Spotting

Scene video text spotting (SVTS) is a very important research topic beca...

A Comprehensive Review on Recent Methods and Challenges of Video Description

Video description involves the generation of the natural language descri...

Video Description: A Survey of Methods, Datasets and Evaluation Metrics

Automatic video description is useful for assisting the visually impaire...

Dual Dense Encoding for Zero-Example Video Retrieval

This paper attacks the challenging problem of zero-example video retriev...

Hypergraph-of-Entity: A General Model for Entity-Oriented Search

The hypergraph-of-entity was conceptually proposed as a general model fo...

A taxonomy of video lecture styles

Many educational organizations are employing instructional video in thei...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.