The VISIONE Video Search System: Exploiting Off-the-Shelf Text Search Engines for Large-Scale Video Retrieval

08/06/2020
by   Giuseppe Amato, et al.
0

In this paper, we describe VISIONE, a video search system that allows users to search for videos using textual keywords, occurrence of objects and their spatial relationships, occurrence of colors and their spatial relationships, and image similarity. These modalities can be combined together to express complex queries and satisfy user needs. The peculiarity of our approach is that we encode all the information extracted from the keyframes, such as visual deep features, tags, color and object locations, using a convenient textual encoding indexed in a single text retrieval engine. This offers great flexibility when results corresponding to various parts of the query needs to be merged. We report an extensive analysis of the system retrieval performance, using the query logs generated during the Video Browser Showdown (VBS) 2019 competition. This allowed us to fine-tune the system by choosing the optimal parameters and strategies among the ones that we tested.

READ FULL TEXT

page 2

page 5

page 6

page 7

page 9

page 10

page 12

page 14

research
06/17/2016

Strategies for Searching Video Content with Text Queries or Video Examples

The large number of user-generated videos uploaded on to the Internet ev...
research
12/24/2013

IVSS Integration of Color Feature Extraction Techniques for Intelligent Video Search Systems

As large amount of visual Information is available on web in form of ima...
research
01/08/2018

DeepStyle: Multimodal Search Engine for Fashion and Interior Design

In this paper, we propose a multimodal search engine that combines visua...
research
03/31/2022

ShapeFindAR: Exploring In-Situ Spatial Search for Physical Artifact Retrieval using Mixed Reality

Personal fabrication is made more accessible through repositories like T...
research
09/17/2018

Dual Dense Encoding for Zero-Example Video Retrieval

This paper attacks the challenging problem of zero-example video retriev...
research
08/02/2023

Rethinking Similarity Search: Embracing Smarter Mechanisms over Smarter Data

In this vision paper, we propose a shift in perspective for improving th...
research
07/21/2017

What Looks Good with my Sofa: Multimodal Search Engine for Interior Design

In this paper, we propose a multi-modal search engine for interior desig...

Please sign up or login with your details

Forgot password? Click here to reset