On Out-of-Distribution Detection for Audio with Deep Nearest Neighbors

10/27/2022
by   Zaharah Bukhsh, et al.
0

Out-of-distribution (OOD) detection is concerned with identifying data points that do not belong to the same distribution as the model's training data. For the safe deployment of predictive models in a real-world environment, it is critical to avoid making confident predictions on OOD inputs as it can lead to potentially dangerous consequences. However, OOD detection largely remains an under-explored area in the audio (and speech) domain. This is despite the fact that audio is a central modality for many tasks, such as speaker diarization, automatic speech recognition, and sound event detection. To address this, we propose to leverage feature-space of the model with deep k-nearest neighbors to detect OOD samples. We show that this simple and flexible method effectively detects OOD inputs across a broad category of audio (and speech) datasets. Specifically, it improves the false positive rate (FPR@TPR95) by 17 AUROC score by 7

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/17/2019

The Audio Auditor: Participant-Level Membership Inference in Voice-Based IoT

Voice interfaces and assistants implemented by various services have bec...
research
08/09/2023

Unsupervised Out-of-Distribution Dialect Detection with Mahalanobis Distance

Dialect classification is used in a variety of applications, such as mac...
research
11/23/2019

Design and Evaluation of a Multi-Domain Trojan Detection Method on Deep Neural Networks

This work corroborates a run-time Trojan detection method exploiting STR...
research
06/01/2023

Encoder-decoder multimodal speaker change detection

The task of speaker change detection (SCD), which detects points where s...
research
02/24/2021

SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter

The ability to automatically detect stuttering events in speech could he...
research
04/13/2022

Out-of-distribution Detection with Deep Nearest Neighbors

Out-of-distribution (OOD) detection is a critical task for deploying mac...
research
07/07/2022

Back to the Basics: Revisiting Out-of-Distribution Detection Baselines

We study simple methods for out-of-distribution (OOD) image detection th...

Please sign up or login with your details

Forgot password? Click here to reset