End-to-End and Self-Supervised Learning for ComParE 2022 Stuttering Sub-Challenge

07/20/2022

∙

In this paper, we present end-to-end and speech embedding based systems trained in a self-supervised fashion to participate in the ACM Multimedia 2022 ComParE Challenge, specifically the stuttering sub-challenge. In particular, we exploit the embeddings from the pre-trained Wav2Vec2.0 model for stuttering detection (SD) on the KSoF dataset. After embedding extraction, we benchmark with several methods for SD. Our proposed self-supervised based SD system achieves a UAR of 36.9 which is 31.32 (DeepSpectrum) challenge baseline (CBL). Moreover, we show that concatenating layer embeddings with Mel-frequency cepstral coefficients (MFCCs) features further improves the UAR of 33.81 respectively over the CBL. Finally, we demonstrate that the summing information across all the layers of Wav2Vec2.0 surpasses the CBL by a relative margin of 45.91 Computational Paralinguistics ChallengE

READ FULL TEXT

End-to-End and Self-Supervised Learning for ComParE 2022 Stuttering Sub-Challenge

Comparing supervised and self-supervised embedding for ExVo Multi-Task learning track

Using Self-Supervised Feature Extractors with Attention for Automatic COVID-19 Detection from Speech

End-to-End Feasible Optimization Proxies for Large-Scale Economic Dispatch

End-to-End Out-of-distribution Detection with Self-supervised Sampling

Scale dependant layer for self-supervised nuclei encoding

Watermarking Images in Self-Supervised Latent Spaces

The ACM Multimedia 2022 Computational Paralinguistics Challenge: Vocalisations, Stuttering, Activity, Mosquitoes

End-to-End and Self-Supervised Learning for ComParE 2022 Stuttering Sub-Challenge

Related Research

Comparing supervised and self-supervised embedding for ExVo Multi-Task learning track

Using Self-Supervised Feature Extractors with Attention for Automatic COVID-19 Detection from Speech

End-to-End Feasible Optimization Proxies for Large-Scale Economic Dispatch

End-to-End Out-of-distribution Detection with Self-supervised Sampling

Scale dependant layer for self-supervised nuclei encoding

Watermarking Images in Self-Supervised Latent Spaces

The ACM Multimedia 2022 Computational Paralinguistics Challenge: Vocalisations, Stuttering, Activity, Mosquitoes