Semantic-aware Speech to Text Transmission with Redundancy Removal

02/07/2022
by   Tianxiao Han, et al.
0

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech to text transmission. We propose a novel end-to-end DL-based transceiver, which includes an attention-based soft alignment module and a redundancy removal module to compress the transmitted data. In particular, the former extracts only the text-related semantic features, and the latter further drops the semantically redundant content, greatly reducing the amount of semantic redundancy compared to existing methods. We also propose a two-stage training scheme, which speeds up the training of the proposed DL model. The simulation results indicate that our proposed method outperforms current methods in terms of the accuracy of the received text and transmission efficiency. Moreover, the proposed method also has a smaller model size and shorter end-to-end runtime.

READ FULL TEXT
research
05/25/2022

Semantic-preserved Communication System for Highly Efficient Speech Transmission

Deep learning (DL) based semantic communication methods have been explor...
research
02/08/2022

Wireless Transmission of Images With The Assistance of Multi-level Semantic Information

Semantic-oriented communication has been considered as a promising to bo...
research
05/09/2022

Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesis

In this paper, we develop a deep learning based semantic communication s...
research
09/18/2023

Semantically Redundant Training Data Removal and Deep Model Classification Performance: A Study with Chest X-rays

Deep learning (DL) has demonstrated its innate capacity to independently...
research
07/22/2021

Semantic Communications for Speech Recognition

The traditional communications transmit all the source date represented ...
research
09/17/2018

Model-Driven Deep Learning for Physical Layer Communications

Intelligent communication is gradually considered as the mainstream dire...
research
06/08/2022

Robust Semantic Communications with Masked VQ-VAE Enabled Codebook

Although semantic communications have exhibited satisfactory performance...

Please sign up or login with your details

Forgot password? Click here to reset