Deep Saliency Prior for Reducing Visual Distraction

by   Kfir Aberman, et al.

Using only a model that was trained to predict where people look at images, and no additional training data, we can produce a range of powerful editing effects for reducing distraction in images. Given an image and a mask specifying the region to edit, we backpropagate through a state-of-the-art saliency model to parameterize a differentiable editing operator, such that the saliency within the masked region is reduced. We demonstrate several operators, including: a recoloring operator, which learns to apply a color transform that camouflages and blends distractors into their surroundings; a warping operator, which warps less salient image regions to cover distractors, gradually collapsing objects into themselves and effectively removing them (an effect akin to inpainting); a GAN operator, which uses a semantic prior to fully replace image regions with plausible, less salient alternatives. The resulting effects are consistent with cognitive research on the human visual system (e.g., since color mismatch is salient, the recoloring operator learns to harmonize objects' colors with their surrounding to reduce their saliency), and, importantly, are all achieved solely through the guidance of the pretrained saliency model, with no additional supervision. We present results on a variety of natural images and conduct a perceptual study to evaluate and validate the changes in viewers' eye-gaze between the original images and our edited results.


page 1

page 2

page 3

page 4

page 5

page 6

page 10

page 11


Salient Region Detection and Segmentation in Images using Dynamic Mode Decomposition

Visual Saliency is the capability of vision system to select distinctive...

Exploiting Egocentric Object Prior for 3D Saliency Detection

On a minute-to-minute basis people undergo numerous fluid interactions w...

A study of parameters affecting visual saliency assessment

Since the early 2000s, computational visual saliency has been a very act...

GuidedMixup: An Efficient Mixup Strategy Guided by Saliency Maps

Data augmentation is now an essential part of the image training process...

Saliency deep embedding for aurora image search

Deep neural networks have achieved remarkable success in the field of im...

Saliency-based segmentation of dermoscopic images using color information

Skin lesion segmentation is one of the crucial steps for an efficient no...

Unsupervised Neural Architecture for Saliency Detection: Extended Version

We propose a novel neural network architecture for visual saliency detec...

Please sign up or login with your details

Forgot password? Click here to reset