Multi-Scale Wavelet Transformer for Face Forgery Detection

10/08/2022
by   Jie Liu, et al.
0

Currently, many face forgery detection methods aggregate spatial and frequency features to enhance the generalization ability and gain promising performance under the cross-dataset scenario. However, these methods only leverage one level frequency information which limits their expressive ability. To overcome these limitations, we propose a multi-scale wavelet transformer framework for face forgery detection. Specifically, to take full advantage of the multi-scale and multi-frequency wavelet representation, we gradually aggregate the multi-scale wavelet representation at different stages of the backbone network. To better fuse the frequency feature with the spatial features, frequency-based spatial attention is designed to guide the spatial feature extractor to concentrate more on forgery traces. Meanwhile, cross-modality attention is proposed to fuse the frequency features with the spatial features. These two attention modules are calculated through a unified transformer block for efficiency. A wide variety of experiments demonstrate that the proposed method is efficient and effective for both within and cross datasets.

READ FULL TEXT

page 3

page 4

page 14

research
03/23/2021

Generalizing Face Forgery Detection with High-frequency Features

Current face forgery detection methods achieve high accuracy under the w...
research
05/06/2020

Manipulated Face Detector: Joint Spatial and Frequency Domain Attention Network

Face manipulation methods develop rapidly in recent years, which can gen...
research
03/27/2018

A Fast Face Detection Method via Convolutional Neural Network

Current face or object detection methods via convolutional neural networ...
research
03/23/2023

Inheriting Bayer's Legacy-Joint Remosaicing and Denoising for Quad Bayer Image Sensor

Pixel binning based Quad sensors have emerged as a promising solution to...
research
07/21/2023

Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection

Due to the successful development of deep image generation technology, v...
research
10/03/2017

Isotropic and Steerable Wavelets in N Dimensions. A multiresolution analysis framework for ITK

This document describes the implementation of the external module ITKIso...
research
07/15/2014

Aggregate channel features for multi-view face detection

Face detection has drawn much attention in recent decades since the semi...

Please sign up or login with your details

Forgot password? Click here to reset