Towards Large yet Imperceptible Adversarial Image Perturbations with Perceptual Color Distance

11/06/2019
by   Zhengyu Zhao, et al.
9

The success of image perturbations that are designed to fool image classification is assessed in terms of both adversarial effect and visual imperceptibility. In this work, we investigate the contribution of human color perception to perturbations that are not noticeable. Our basic insight is that perceptual color distance makes it possible to drop the conventional assumption that imperceptible perturbations should strive for small L_p norms in RGB space. Our first approach, Perceptual Color distance C W (PerC-C W), extends the widely-used C W approach and produces larger RGB perturbations. PerC-C W is able to maintain adversarial strength, while contributing to imperceptibility. Our second approach, Perceptual Color distance Alternating Loss (PerC-AL), achieves the same outcome, but does so more efficiently by alternating between the classification loss and perceptual color difference when updating perturbations. Experimental evaluation shows PerC approaches improve robustness and transferability of perturbations over conventional approaches and also demonstrates that the PerC distance can provide added value on top of existing structure-based approaches to creating image perturbations.

READ FULL TEXT

page 1

page 2

page 7

page 8

research
11/23/2012

Improving Perceptual Color Difference using Basic Color Terms

We suggest a new color distance based on two observations. First, percep...
research
02/03/2020

A Differentiable Color Filter for Generating Unrestricted Adversarial Images

We propose Adversarial Color Filtering (AdvCF), an approach that uses a ...
research
08/28/2020

Color and Edge-Aware Adversarial Image Perturbations

Adversarial perturbation of images, in which a source image is deliberat...
research
08/14/2023

Robustified ANNs Reveal Wormholes Between Human Category Percepts

The visual object category reports of artificial neural networks (ANNs) ...
research
10/15/2018

CSV: Image Quality Assessment Based on Color, Structure, and Visual System

This paper presents a full-reference image quality estimator based on co...
research
05/16/2020

JNCD-Based Perceptual Compression of RGB 4:4:4 Image Data

In contemporary lossy image coding applications, a desired aim is to dec...
research
09/07/2020

Semantic Discriminability for Visual Communication

To interpret information visualizations, observers must determine how vi...

Please sign up or login with your details

Forgot password? Click here to reset