Semantic Image Retrieval by Uniting Deep Neural Networks and Cognitive Architectures

06/14/2018
by   Alexey Potapov, et al.
0

Image and video retrieval by their semantic content has been an important and challenging task for years, because it ultimately requires bridging the symbolic/subsymbolic gap. Recent successes in deep learning enabled detection of objects belonging to many classes greatly outperforming traditional computer vision techniques. However, deep learning solutions capable of executing retrieval queries are still not available. We propose a hybrid solution consisting of a deep neural network for object detection and a cognitive architecture for query execution. Specifically, we use YOLOv2 and OpenCog. Queries allowing the retrieval of video frames containing objects of specified classes and specified spatial arrangement are implemented.

READ FULL TEXT

page 4

page 8

page 9

research
11/12/2020

Content-based Image Retrieval and the Semantic Gap in the Deep Learning Era

Content-based image retrieval has seen astonishing progress over the pas...
research
06/29/2017

CS591 Report: Application of siamesa network in 2D transformation

Deep learning has been extensively used various aspects of computer visi...
research
05/14/2020

Detection and Retrieval of Out-of-Distribution Objects in Semantic Segmentation

When deploying deep learning technology in self-driving cars, deep neura...
research
03/30/2022

Rabbit, toad, and the Moon: Can machine categorize them into one class?

Recent machine learning algorithms such as neural networks can classify ...
research
03/02/2020

Evaluating Temporal Queries Over Video Feeds

Recent advances in Computer Vision and Deep Learning made possible the e...
research
02/24/2020

Video Monitoring Queries

Recent advances in video processing utilizing deep learning primitives a...
research
09/30/2020

Encode the Unseen: Predictive Video Hashing for Scalable Mid-Stream Retrieval

This paper tackles a new problem in computer vision: mid-stream video-to...

Please sign up or login with your details

Forgot password? Click here to reset