Discovering Transferable Forensic Features for CNN-generated Images Detection

Visual counterfeits are increasingly causing an existential conundrum in mainstream media with rapid evolution in neural image synthesis methods. Though detection of such counterfeits has been a taxing problem in the image forensics community, a recent class of forensic detectors – universal detectors – are able to surprisingly spot counterfeit images regardless of generator architectures, loss functions, training datasets, and resolutions. This intriguing property suggests the possible existence of transferable forensic features (T-FF) in universal detectors. In this work, we conduct the first analytical study to discover and understand T-FF in universal detectors. Our contributions are 2-fold: 1) We propose a novel forensic feature relevance statistic (FF-RS) to quantify and discover T-FF in universal detectors and, 2) Our qualitative and quantitative investigations uncover an unexpected finding: color is a critical T-FF in universal detectors. Code and models are available at https://keshik6.github.io/transferable-forensic-features/

READ FULL TEXT

page 2

page 5

page 24

page 25

page 31

page 32

page 33

page 34

research
11/17/2020

SRF-GAN: Super-Resolved Feature GAN for Multi-Scale Representation

Recent convolutional object detectors exploit multi-scale feature repres...
research
08/13/2019

Construction of efficient detectors for character information recognition

We have developed and tested in numerical experiments a universal approa...
research
03/27/2013

Developing and Analyzing Boundary Detection Operators Using Probabilistic Models

Most feature detectors such as edge detectors or circle finders are stat...
research
12/23/2019

CNN-generated images are surprisingly easy to spot... for now

In this work we ask whether it is possible to create a "universal" detec...
research
11/01/2022

On the detection of synthetic images generated by diffusion models

Over the past decade, there has been tremendous progress in creating syn...
research
02/09/2021

Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search

Designing proper loss functions for vision tasks has been a long-standin...
research
08/08/2023

How Generalizable are Deepfake Detectors? An Empirical Study

Deepfake videos and images are becoming increasingly credible, posing a ...

Please sign up or login with your details

Forgot password? Click here to reset