TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domains

04/27/2021
by   George Awad, et al.
2

The TREC Video Retrieval Evaluation (TRECVID) is a TREC-style video analysis and retrieval evaluation with the goal of promoting progress in research and development of content-based exploitation and retrieval of information from digital video via open, metrics-based evaluation. Over the last twenty years this effort has yielded a better understanding of how systems can effectively accomplish such processing and how one can reliably benchmark their performance. TRECVID has been funded by NIST (National Institute of Standards and Technology) and other US government agencies. In addition, many organizations and individuals worldwide contribute significant time and effort. TRECVID 2020 represented a continuation of four tasks and the addition of two new tasks. In total, 29 teams from various research organizations worldwide completed one or more of the following six tasks: 1. Ad-hoc Video Search (AVS), 2. Instance Search (INS), 3. Disaster Scene Description and Indexing (DSDI), 4. Video to Text Description (VTT), 5. Activities in Extended Video (ActEV), 6. Video Summarization (VSUM). This paper is an introduction to the evaluation framework, tasks, data, and measures used in the evaluation campaign.

READ FULL TEXT

page 5

page 13

page 20

page 23

page 34

page 35

page 38

page 39

research
09/21/2020

TRECVID 2019: An Evaluation Campaign to Benchmark Video Activity Detection, Video Captioning and Matching, and Video Search Retrieval

The TREC Video Retrieval Evaluation (TRECVID) 2019 was a TREC-style vide...
research
06/22/2023

An overview on the evaluated video retrieval tasks at TRECVID 2022

The TREC Video Retrieval Evaluation (TRECVID) is a TREC-style video anal...
research
07/26/2021

ICDAR 2021 Competition on Scene Video Text Spotting

Scene video text spotting (SVTS) is a very important research topic beca...
research
11/30/2020

A Comprehensive Review on Recent Methods and Challenges of Video Description

Video description involves the generation of the natural language descri...
research
06/01/2018

Video Description: A Survey of Methods, Datasets and Evaluation Metrics

Automatic video description is useful for assisting the visually impaire...
research
09/17/2023

Towards Debiasing Frame Length Bias in Text-Video Retrieval via Causal Intervention

Many studies focus on improving pretraining or developing new backbones ...
research
05/05/2022

Introducing the Welsh Text Summarisation Dataset and Baseline Systems

Welsh is an official language in Wales and is spoken by an estimated 884...

Please sign up or login with your details

Forgot password? Click here to reset