Learning visual biases from human imagination

10/17/2014
by   Carl Vondrick, et al.
0

Although the human visual system can recognize many concepts under challenging conditions, it still has some biases. In this paper, we investigate whether we can extract these biases and transfer them into a machine recognition system. We introduce a novel method that, inspired by well-known tools in human psychophysics, estimates the biases that the human visual system might use for recognition, but in computer vision feature spaces. Our experiments are surprising, and suggest that classifiers from the human visual system can be transferred into a machine with some success. Since these classifiers seem to capture favorable biases in the human visual system, we further present an SVM formulation that constrains the orientation of the SVM hyperplane to agree with the bias from human visual system. Our results suggest that transferring this human bias into machines may help object recognition systems generalize across datasets and perform better when very little training data is available.

READ FULL TEXT

page 2

page 4

page 5

page 6

research
03/14/2023

Variation of Gender Biases in Visual Recognition Models Before and After Finetuning

We introduce a framework to measure how biases change before and after f...
research
07/16/2021

A Survey on Bias in Visual Datasets

Computer Vision (CV) has achieved remarkable results, outperforming huma...
research
04/11/2019

Reducing Lateral Visual Biases in Displays

The human visual system is composed of multiple physiological components...
research
08/18/2023

End-to-end topographic networks as models of cortical map formation and human visual behaviour: moving beyond convolutions

Computational models are an essential tool for understanding the origin ...
research
12/12/2022

Doubly Right Object Recognition: A Why Prompt for Visual Rationales

Many visual recognition models are evaluated only on their classificatio...
research
03/03/2022

A study on the distribution of social biases in self-supervised learning visual models

Deep neural networks are efficient at learning the data distribution if ...
research
01/26/2018

Neural Algebra of Classifiers

The world is fundamentally compositional, so it is natural to think of v...

Please sign up or login with your details

Forgot password? Click here to reset