Finding any Waldo: zero-shot invariant and efficient visual search

07/18/2018
by   Mengmi Zhang, et al.
0

Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work has focused on searching for perfect matches of a target after extensive category-specific training. Here we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/24/2022

Efficient Zero-shot Visual Search via Target and Context-aware Transformer

Visual search is a ubiquitous challenge in natural vision, including dai...
research
04/27/2016

Zero-shot object prediction using semantic scene knowledge

This work focuses on the semantic relations between scenes and objects f...
research
03/10/2023

Zero-Shot Object Searching Using Large-scale Object Relationship Prior

Home-assistant robots have been a long-standing research topic, and one ...
research
05/25/2020

What am I Searching for: Zero-shot Target Identity Inference in Visual Search

Can we infer intentions from a person's actions? As an example problem, ...
research
06/05/2021

Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biases

Visual search is a ubiquitous and often challenging daily task, exemplif...
research
02/18/2015

Prediction of Search Targets From Fixations in Open-World Settings

Previous work on predicting the target of visual search from human fixat...
research
08/11/2018

Target Image Video Search Based on Local Features

This paper presents a new search algorithm called Target Image Search ba...

Please sign up or login with your details

Forgot password? Click here to reset