Simultaneously Learning Robust Audio Embeddings and balanced Hash codes for Query-by-Example

11/20/2022
by   Anup Singh, et al.
0

Audio fingerprinting systems must efficiently and robustly identify query snippets in an extensive database. To this end, state-of-the-art systems use deep learning to generate compact audio fingerprints. These systems deploy indexing methods, which quantize fingerprints to hash codes in an unsupervised manner to expedite the search. However, these methods generate imbalanced hash codes, leading to their suboptimal performance. Therefore, we propose a self-supervised learning framework to compute fingerprints and balanced hash codes in an end-to-end manner to achieve both fast and accurate retrieval performance. We model hash codes as a balanced clustering process, which we regard as an instance of the optimal transport problem. Experimental results indicate that the proposed approach improves retrieval efficiency while preserving high accuracy, particularly at high distortion levels, compared to the competing methods. Moreover, our system is efficient and scalable in computational load and memory storage.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/16/2022

Attention-Based Audio Embeddings for Query-by-Example

An ideal audio retrieval system efficiently and robustly recognizes a sh...
research
09/04/2018

Deep Priority Hashing

Deep hashing enables image retrieval by end-to-end learning of deep repr...
research
02/02/2017

HashNet: Deep Learning to Hash by Continuation

Learning to hash has been widely applied to approximate nearest neighbor...
research
09/04/2021

Representation Learning for Efficient and Effective Similarity Search and Recommendation

How data is represented and operationalized is critical for building com...
research
02/07/2018

Self-Supervised Video Hashing with Hierarchical Binary Auto-encoder

Existing video hash functions are built on three isolated stages: frame ...
research
05/16/2023

Robust and lightweight audio fingerprint for Automatic Content Recognition

This research paper presents a novel audio fingerprinting system for Aut...

Please sign up or login with your details

Forgot password? Click here to reset