Manifold-Aware Deep Clustering: Maximizing Angles between Embedding Vectors Based on Regular Simplex

06/04/2021
by   Keitaro Tanaka, et al.
0

This paper presents a new deep clustering (DC) method called manifold-aware DC (M-DC) that can enhance hyperspace utilization more effectively than the original DC. The original DC has a limitation in that a pair of two speakers has to be embedded having an orthogonal relationship due to its use of the one-hot vector-based loss function, while our method derives a unique loss function aimed at maximizing the target angle in the hyperspace based on the nature of a regular simplex. Our proposed loss imposes a higher penalty than the original DC when the speaker is assigned incorrectly. The change from DC to M-DC can be easily achieved by rewriting just one term in the loss function of DC, without any other modifications to the network architecture or model parameters. As such, our method has high practicability because it does not affect the original inference part. The experimental results show that the proposed method improves the performances of the original DC and its expansion method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/18/2020

X-DC: Explainable Deep Clustering based on Learnable Spectrogram Templates

Deep neural networks (DNNs) have achieved substantial predictive perform...
research
06/27/2021

Machine Learning Detection Algorithm for Large Barkhausen Jumps in Cluttered Environment

Modern magnetic sensor arrays conventionally utilize state of the art lo...
research
08/14/2017

DC-Prophet: Predicting Catastrophic Machine Failures in DataCenters

When will a server fail catastrophically in an industrial datacenter? Is...
research
05/22/2023

Deep Clustering for Data Cleaning and Integration

Deep Learning (DL) techniques now constitute the state-of-the-art for im...
research
07/02/2023

Revisiting the specification decomposition for synthesis based on LTL solvers

Recently, several algorithms have been proposed for decomposing reactive...
research
11/13/2019

Coarse-Refinement Dilemma: On Generalization Bounds for Data Clustering

The Data Clustering (DC) problem is of central importance for the area o...
research
02/07/2022

Dataset Condensation with Contrastive Signals

Recent studies have demonstrated that gradient matching-based dataset sy...

Please sign up or login with your details

Forgot password? Click here to reset