Digital Audio Tampering Detection Based on ENF Spatio-temporal Features Representation Learning

08/25/2022
by   Chunyan Zeng, et al.
0

Most digital audio tampering detection methods based on electrical network frequency (ENF) only utilize the static spatial information of ENF, ignoring the variation of ENF in time series, which limit the ability of ENF feature representation and reduce the accuracy of tampering detection. This paper proposes a new method for digital audio tampering detection based on ENF spatio-temporal features representation learning. A parallel spatio-temporal network model is constructed using CNN and BiLSTM, which deeply extracts ENF spatial feature information and ENF temporal feature information to enhance the feature representation capability to improve the tampering detection accuracy. In order to extract the spatial and temporal features of the ENF, this paper firstly uses digital audio high-precision Discrete Fourier Transform analysis to extract the phase sequences of the ENF. The unequal phase series is divided into frames by adaptive frame shifting to obtain feature matrices of the same size to represent the spatial features of the ENF. At the same time, the phase sequences are divided into frames based on ENF time changes information to represent the temporal features of the ENF. Then deep spatial and temporal features are further extracted using CNN and BiLSTM respectively, and an attention mechanism is used to adaptively assign weights to the deep spatial and temporal features to obtain spatio-temporal features with stronger representation capability. Finally, the deep neural network is used to determine whether the audio has been tampered with. The experimental results show that the proposed method improves the accuracy by 2.12 with state-of-the-art methods under the public database Carioca, New Spanish.

READ FULL TEXT

page 11

page 12

research
10/19/2022

Audio Tampering Detection Based on Shallow and Deep Feature Representation Learning

Digital audio tampering detection can be used to verify the authenticity...
research
02/15/2023

DKT-STDRL: Spatial and Temporal Representation Learning Enhanced Deep Knowledge Tracing for Learning Performance Prediction

Knowledge tracing (KT) serves as a primary part of intelligent education...
research
10/22/2019

Drivers Drowsiness Detection using Condition-Adaptive Representation Learning Framework

We propose a condition-adaptive representation learning framework for th...
research
12/05/2022

End-to-end Recording Device Identification Based on Deep Representation Learning

Deep learning techniques have achieved specific results in recording dev...
research
12/20/2019

Saliency Based Fire Detection Using Texture and Color Features

Due to industry deployment and extension of urban areas, early warning s...
research
01/15/2013

Recurrent Online Clustering as a Spatio-Temporal Feature Extractor in DeSTIN

This paper presents a basic enhancement to the DeSTIN deep learning arch...
research
07/15/2021

Motor Imagery Classification based on CNN-GRU Network with Spatio-Temporal Feature Representation

Recently, various deep neural networks have been applied to classify ele...

Please sign up or login with your details

Forgot password? Click here to reset