Effective Image Tampering Localization via Enhanced Transformer and Co-attention Fusion

09/17/2023
by   Kun Guo, et al.
0

Powerful manipulation techniques have made digital image forgeries be easily created and widespread without leaving visual anomalies. The blind localization of tampered regions becomes quite significant for image forensics. In this paper, we propose an effective image tampering localization network (EITLNet) based on a two-branch enhanced transformer encoder with attention-based feature fusion. Specifically, a feature enhancement module is designed to enhance the feature representation ability of the transformer encoder. The features extracted from RGB and noise streams are fused effectively by the coordinate attention-based fusion module at multiple scales. Extensive experimental results verify that the proposed scheme achieves the state-of-the-art generalization ability and robustness in various benchmark datasets. Code will be public at https://github.com/multimediaFor/EITLNet.

READ FULL TEXT

page 2

page 3

research
07/19/2021

Image Fusion Transformer

In image fusion, images obtained from different sensors are fused to gen...
research
08/29/2022

Effective Image Tampering Localization via Semantic Segmentation Network

With the widespread use of powerful image editing tools, image tampering...
research
02/25/2023

TBFormer: Two-Branch Transformer for Image Forgery Localization

Image forgery localization aims to identify forged regions by capturing ...
research
09/18/2023

Spatio-temporal Co-attention Fusion Network for Video Splicing Localization

Digital video splicing has become easy and ubiquitous. Malicious users c...
research
10/18/2022

Multimodal Image Fusion based on Hybrid CNN-Transformer and Non-local Cross-modal Attention

The fusion of images taken by heterogeneous sensors helps to enrich the ...
research
07/27/2023

IML-ViT: Image Manipulation Localization by Vision Transformer

Advanced image tampering techniques are increasingly challenging the tru...
research
04/29/2022

Where in the World is this Image? Transformer-based Geo-localization in the Wild

Predicting the geographic location (geo-localization) from a single grou...

Please sign up or login with your details

Forgot password? Click here to reset