Interactive Video Retrieval with Dialog

05/07/2019
by   Sho Maeoki, et al.
21

Now that everyone can easily record videos, the quantity of which is continuously increasing, research on methods for improved video retrieval is important in the contemporary world. In cases where target videos are to be identified within a large collection gathered by individuals, the appropriate information must be obtained to retrieve the correct video within a large number of similar items in the target database. The purpose of this research is to retrieve target videos in such cases by introducing an interaction, or a dialog, between the system and the user. We propose a system to retrieve videos by asking questions about the content of the videos and leveraging the user's responses to the questions. Additionally, we confirmed the usefulness of the proposed system through experiments using the dataset called AVSD which includes videos and dialogs about the videos.

READ FULL TEXT

page 2

page 9

research
05/11/2022

Learning to Retrieve Videos by Asking Questions

The majority of traditional text-to-video retrieval systems operate in s...
research
05/28/2022

Find Your ASMR: A Perceptual Retrieval Interface for Autonomous Sensory Meridian Response Videos

Autonomous sensory meridian response (ASMR) is a type of video contents ...
research
01/27/2022

Hierarchical Visual Interface for Lecture Video Retrieval and Summarization

With the emergence of large-scale open online courses and online academi...
research
09/11/2018

FIVR: Fine-grained Incident Video Retrieval

This paper introduces the problem of Fine-grained Incident Video Retriev...
research
04/09/2016

Scene-driven Retrieval in Edited Videos using Aesthetic and Semantic Deep Features

This paper presents a novel retrieval pipeline for video collections, wh...
research
04/29/2015

Visual Information Retrieval in Endoscopic Video Archives

In endoscopic procedures, surgeons work with live video streams from the...
research
09/05/2019

Closed ASL Interpreting for Online Videos

Deaf individuals face great challenges in today's society. It can be ver...

Please sign up or login with your details

Forgot password? Click here to reset