Augmented Contrastive Self-Supervised Learning for Audio Invariant Representations

12/21/2021
by   Melikasadat Emami, et al.
0

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification tasks. In this work, we propose an augmented contrastive SSL framework to learn invariant representations from unlabeled data. Our method applies various perturbations to the unlabeled input data and utilizes contrastive learning to learn representations robust to such perturbations. Experimental results on the Audioset and DESED datasets show that our framework significantly outperforms state-of-the-art SSL and supervised learning methods on sound/event classification tasks.

READ FULL TEXT
research
11/15/2020

Unsupervised Contrastive Learning of Sound Event Representations

Self-supervised representation learning can mitigate the limitations in ...
research
03/07/2023

Improving Self-Supervised Learning for Audio Representations by Feature Diversity and Decorrelation

Self-supervised learning (SSL) has recently shown remarkable results in ...
research
10/19/2019

Label-efficient audio classification through multitask learning and self-supervision

While deep learning has been incredibly successful in modeling tasks wit...
research
01/11/2023

GraVIS: Grouping Augmented Views from Independent Sources for Dermatology Analysis

Self-supervised representation learning has been extremely successful in...
research
04/07/2023

Anomalous Sound Detection using Audio Representation with Machine ID based Contrastive Learning Pretraining

Existing contrastive learning methods for anomalous sound detection refi...
research
03/05/2021

Extending Contrastive Learning to Unsupervised Coreset Selection

Self-supervised contrastive learning offers a means of learning informat...
research
11/26/2021

ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Genetics

High annotation costs are a substantial bottleneck in applying modern de...

Please sign up or login with your details

Forgot password? Click here to reset