All for One and One for All: Improving Music Separation by Bridging Networks

10/08/2020
by   Ryosuke Sawata, et al.
0

This paper proposes several improvements for music separation with deep neural networks(DNNs), namely a multi-domain loss(MDL) and two combination schemes. First, by using MDL we take advantage of the frequency and time domain representation of audio signals. Next, we utilize the relationship among instruments by jointly considering them. We do this on the one hand by modifying the network architecture and introducing a CrossNet structure. On the other hand, we consider combinations of instrument estimates by using a new combination loss(CL). MDL and CL can easily be applied to many existing DNN-based separation methods as they are merely loss functions which are only used during training and which do not affect the inference step. Experimental results show that the performance of Open-Unmix (UMX), a well-known and state-of-the-art open source library for music separation, can be improved by utilizing our above schemes. Our modifications of UMX will be open-sourced together with this paper.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
05/13/2023

The Whole Is Greater than the Sum of Its Parts: Improving DNN-based Music Source Separation

This paper presents the crossing scheme (X-scheme) for improving the per...
research
06/10/2021

Independent Deeply Learned Tensor Analysis for Determined Audio Source Separation

We address the determined audio source separation problem in the time-fr...
research
07/07/2018

Improving DNN-based Music Source Separation using Phase Features

Music source separation with deep neural networks typically relies only ...
research
05/31/2016

Deep convolutional neural networks for predominant instrument recognition in polyphonic music

Identifying musical instruments in polyphonic music recordings is a chal...
research
06/16/2021

A Hands-on Comparison of DNNs for Dialog Separation Using Transfer Learning from Music Source Separation

This paper describes a hands-on comparison on using state-of-the-art mus...
research
10/29/2018

A context encoder for audio inpainting

We studied the ability of deep neural networks (DNNs) to restore missing...
research
04/17/2018

The 2018 Signal Separation Evaluation Campaign

This paper reports the organization and results for the 2018 community-b...

Please sign up or login with your details

Forgot password? Click here to reset