Learning to Detect Novel and Fine-Grained Acoustic Sequences Using Pretrained Audio Representations

05/03/2023
by   Vasudha Kowtha, et al.
0

This work investigates pretrained audio representations for few shot Sound Event Detection. We specifically address the task of few shot detection of novel acoustic sequences, or sound events with semantically meaningful temporal structure, without assuming access to non-target audio. We develop procedures for pretraining suitable representations, and methods which transfer them to our few shot learning scenario. Our experiments evaluate the general purpose utility of our pretrained representations on AudioSet, and the utility of proposed few shot methods via tasks constructed from real-world acoustic sequences. Our pretrained embeddings are suitable to the proposed task, and enable multiple aspects of our few shot framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2021

Audiovisual transfer learning for audio tagging and sound event detection

We study the merit of transfer learning for two sound recognition proble...
research
09/16/2023

Regularized Contrastive Pre-training for Few-shot Bioacoustic Sound Detection

Bioacoustic sound event detection allows for better understanding of ani...
research
05/22/2023

Learning to detect an animal sound from five examples

Automatic detection and classification of animal sounds has many applica...
research
10/27/2022

Multi-dimensional Edge-based Audio Event Relational Graph Representation Learning for Acoustic Scene Classification

Most existing deep learning-based acoustic scene classification (ASC) ap...
research
04/10/2023

Leveraging Neural Representations for Audio Manipulation

We investigate applying audio manipulations using pretrained neural netw...
research
02/26/2020

An Open-set Recognition and Few-Shot Learning Dataset for Audio Event Classification in Domestic Environments

The problem of training a deep neural network with a small set of positi...
research
03/07/2023

AST-SED: An Effective Sound Event Detection Method Based on Audio Spectrogram Transformer

In this paper, we propose an effective sound event detection (SED) metho...

Please sign up or login with your details

Forgot password? Click here to reset