Adversarial Auto-Encoding for Packet Loss Concealment

07/07/2021
by   Santiago Pascual, et al.
0

Communication technologies like voice over IP operate under constrained real-time conditions, with voice packets being subject to delays and losses from the network. In such cases, the packet loss concealment (PLC) algorithm reconstructs missing frames until a new real packet is received. Recently, autoregressive deep neural networks have been shown to surpass the quality of signal processing methods for PLC, specially for long-term predictions beyond 60 ms. In this work, we propose a non-autoregressive adversarial auto-encoder, named PLAAE, to perform real-time PLC in the waveform domain. PLAAE has a causal convolutional structure, and it learns in an auto-encoder fashion to reconstruct signals with gaps, with the help of an adversarial loss. During inference, it is able to predict smooth and coherent continuations of such gaps in a single feed-forward step, as opposed to autoregressive models. Our evaluation highlights the superiority of PLAAE over two classic PLCs and two deep autoregressive models in terms of spectral and intonation reconstruction, perceptual quality, and intelligibility.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2023

Grace++: Loss-Resilient Real-Time Video Communication under High Network Latency

In real-time videos, resending any packets, especially in networks with ...
research
07/04/2022

TMGAN-PLC: Audio Packet Loss Concealment using Temporal Memory Generative Adversarial Network

Real-time communications in packet-switched networks have become widely ...
research
12/16/2019

Improving Conversation Quality for VoIP Through Block Erasure Coding

The conversational quality of voice over IP (VoIP) depends on packet-los...
research
03/26/2022

A Neural Vocoder Based Packet Loss Concealment Algorithm

The packet loss problem seriously affects the quality of service in Voic...
research
10/28/2019

The Effect of Erasure Coding on the Burstiness of Packet Loss

The perceived quality of real-time media delivered over IP networks depe...
research
11/08/2022

Improving performance of real-time full-band blind packet-loss concealment with predictive network

Packet loss concealment (PLC) is a tool for enhancing speech degradation...
research
04/08/2022

Analysis and transformations of intensity in singing voice

In this paper we introduce a neural auto-encoder that transforms the voi...

Please sign up or login with your details

Forgot password? Click here to reset