AccEar: Accelerometer Acoustic Eavesdropping with Unconstrained Vocabulary

12/02/2022
by   Pengfei Hu, et al.
0

With the increasing popularity of voice-based applications, acoustic eavesdropping has become a serious threat to users' privacy. While on smartphones the access to microphones needs an explicit user permission, acoustic eavesdropping attacks can rely on motion sensors (such as accelerometer and gyroscope), which access is unrestricted. However, previous instances of such attacks can only recognize a limited set of pre-trained words or phrases. In this paper, we present AccEar, an accelerometerbased acoustic eavesdropping attack that can reconstruct any audio played on the smartphone's loudspeaker with unconstrained vocabulary. We show that an attacker can employ a conditional Generative Adversarial Network (cGAN) to reconstruct highfidelity audio from low-frequency accelerometer signals. The presented cGAN model learns to recreate high-frequency components of the user's voice from low-frequency accelerometer signals through spectrogram enhancement. We assess the feasibility and effectiveness of AccEar attack in a thorough set of experiments using audio from 16 public personalities. As shown by the results in both objective and subjective evaluations, AccEar successfully reconstructs user speeches from accelerometer signals in different scenarios including varying sampling rate, audio volume, device model, etc.

READ FULL TEXT

page 3

page 5

page 9

page 11

page 12

page 13

page 17

research
02/05/2022

GhostTalk: Interactive Attack on Smartphone Voice System Through Power Line

Inaudible voice command injection is one of the most threatening attacks...
research
06/01/2021

A Continuous Liveness Detection for Voice Authentication on Smart Devices

Voice biometrics is drawing increasing attention as it is a promising al...
research
05/03/2022

Frequency Domain-Based Detection of Generated Audio

Attackers may manipulate audio with the intent of presenting falsified r...
research
03/26/2019

Hearing your touch: A new acoustic side channel on smartphones

We present the first acoustic side-channel attack that recovers what use...
research
09/20/2023

A Survey on Acoustic Side Channel Attacks on Keyboards

In today's digital world, protecting personal and sensitive information ...
research
10/21/2022

Audio-to-Intent Using Acoustic-Textual Subword Representations from End-to-End ASR

Accurate prediction of the user intent to interact with a voice assistan...
research
01/13/2020

Two Channel Audio Zooming System For Smartphone

In this paper, two microphone based systems for audio zooming is propose...

Please sign up or login with your details

Forgot password? Click here to reset