A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detection

CNN-based generative modelling has evolved to produce synthetic images indistinguishable from real images in the RGB pixel space. Recent works have observed that CNN-generated images share a systematic shortcoming in replicating high frequency Fourier spectrum decay attributes. Furthermore, these works have successfully exploited this systematic shortcoming to detect CNN-generated images reporting up to 99 state-of-the-art GAN models. In this work, we investigate the validity of assertions claiming that CNN-generated images are unable to achieve high frequency spectral decay consistency. We meticulously construct a counterexample space of high frequency spectral decay consistent CNN-generated images emerging from our handcrafted experiments using DCGAN, LSGAN, WGAN-GP and StarGAN, where we empirically show that this frequency discrepancy can be avoided by a minor architecture change in the last upsampling operation. We subsequently use images from this counterexample space to successfully bypass the recently proposed forensics detector which leverages on high frequency Fourier spectrum decay attributes for CNN-generated image detection. Through this study, we show that high frequency Fourier spectrum decay discrepancies are not inherent characteristics for existing CNN-based generative models–contrary to the belief of some existing work–, and such features are not robust to perform synthetic image detection. Our results prompt re-thinking of using high frequency Fourier spectrum decay attributes for CNN-generated image detection. Code and models are available at https://keshik6.github.io/Fourier-Discrepancies-CNN-Detection/

READ FULL TEXT

page 8

page 14

page 15

page 16

page 17

page 18

page 19

research
11/15/2019

Fourier Spectrum Discrepancies in Deep Network Generated Images

Advancements in deep generative models such as generative adversarial ne...
research
07/29/2023

Fingerprints of Generative Models in the Frequency Domain

It is verified in existing works that CNN-based generative models leave ...
research
11/07/2021

A-PixelHop: A Green, Robust and Explainable Fake-Image Detector

A novel method for detecting CNN-generated images, called Attentive Pixe...
research
09/20/2019

Fourier-CPPNs for Image Synthesis

Compositional Pattern Producing Networks (CPPNs) are differentiable netw...
research
03/03/2020

Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributions

Generative convolutional deep neural networks, e.g. popular GAN architec...
research
09/07/2022

Joint Learning of Deep Texture and High-Frequency Features for Computer-Generated Image Detection

Distinguishing between computer-generated (CG) and natural photographic ...
research
01/19/2022

Simpler is better: spectral regularization and up-sampling techniques for variational autoencoders

Full characterization of the spectral behavior of generative models base...

Please sign up or login with your details

Forgot password? Click here to reset