CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images

03/24/2023
by   Jordan J. Bird, et al.
0

Recent technological advances in synthetic data have enabled the generation of images with such high quality that human beings cannot tell the difference between real-life photographs and Artificial Intelligence (AI) generated images. Given the critical necessity of data reliability and authentication, this article proposes to enhance our ability to recognise AI-generated images through computer vision. Initially, a synthetic dataset is generated that mirrors the ten classes of the already available CIFAR-10 dataset with latent diffusion which provides a contrasting set of images for comparison to real photographs. The model is capable of generating complex visual attributes, such as photorealistic reflections in water. The two sets of data present as a binary classification problem with regard to whether the photograph is real or generated by AI. This study then proposes the use of a Convolutional Neural Network (CNN) to classify the images into two categories; Real or Fake. Following hyperparameter tuning and the training of 36 individual network topologies, the optimal approach could correctly classify the images with 92.98 Class Activation Mapping to explore which features within the images are useful for classification. Interpretation reveals interesting concepts within the image, in particular, noting that the actual entity itself does not hold useful information for classification; instead, the model focuses on small visual imperfections in the background of the images. The complete dataset engineered for this study, referred to as the CIFAKE dataset, is made publicly available to the research community for future work.

READ FULL TEXT

page 4

page 7

page 8

page 11

research
03/01/2023

Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models

The image deepfake detection task has been greatly addressed by the scie...
research
07/09/2023

A Novel Explainable Artificial Intelligence Model in Image Classification problem

In recent years, artificial intelligence is increasingly being applied w...
research
09/07/2022

Explainable Artificial Intelligence to Detect Image Spam Using Convolutional Neural Network

Image spam threat detection has continually been a popular area of resea...
research
06/05/2023

Automating Style Analysis and Visualization With Explainable AI – Case Studies on Brand Recognition

Incorporating style-related objectives into shape design has been centra...
research
08/23/2023

Augmenting medical image classifiers with synthetic data from latent diffusion models

While hundreds of artificial intelligence (AI) algorithms are now approv...
research
04/26/2019

DeepFreak: Learning Crystallography Diffraction Patterns with Automated Machine Learning

Serial crystallography is the field of science that studies the structur...

Please sign up or login with your details

Forgot password? Click here to reset