Privacy-Preserving Image Classification Using Vision Transformer

05/24/2022
by   Zheng Qi, et al.
0

In this paper, we propose a privacy-preserving image classification method that is based on the combined use of encrypted images and the vision transformer (ViT). The proposed method allows us not only to apply images without visual information to ViT models for both training and testing but to also maintain a high classification accuracy. ViT utilizes patch embedding and position embedding for image patches, so this architecture is shown to reduce the influence of block-wise image transformation. In an experiment, the proposed method for privacy-preserving image classification is demonstrated to outperform state-of-the-art methods in terms of classification accuracy and robustness against various attacks.

READ FULL TEXT

page 2

page 4

research
04/16/2022

Privacy-Preserving Image Classification Using Isotropic Network

In this paper, we propose a privacy-preserving image classification meth...
research
01/23/2023

Combined Use of Federated Learning and Image Encryption for Privacy-Preserving Image Classification with Vision Transformer

In recent years, privacy-preserving methods for deep learning have becom...
research
01/10/2023

A Privacy Preserving Method with a Random Orthogonal Matrix for ConvMixer Models

In this paper, a privacy preserving image classification method is propo...
research
04/16/2023

Shuffled Transformer for Privacy-Preserving Split Learning

In conventional split learning, training and testing data often face sev...
research
08/04/2022

Privacy-Preserving Image Classification Using ConvMixer with Adaptive Permutation Matrix

In this paper, we propose a privacy-preserving image classification meth...
research
05/31/2023

Bytes Are All You Need: Transformers Operating Directly On File Bytes

Modern deep learning approaches usually transform inputs into a modality...
research
01/25/2022

Pre-Trained Language Transformers are Universal Image Classifiers

Facial images disclose many hidden personal traits such as age, gender, ...

Please sign up or login with your details

Forgot password? Click here to reset