research
∙
08/14/2023
The Sound Demixing Challenge 2023 x2013 Cinematic Demixing Track
This paper summarizes the cinematic demixing (CDX) track of the Sound De...
share
research
∙
06/27/2023
Style-transfer based Speech and Audio-visual Scene Understanding for Robot Action Sequence Acquisition from Videos
To realize human-robot collaboration, robots need to execute actions for...
research
∙
04/04/2023
Pac-HuBERT: Self-Supervised Music Source Separation via Primitive Auditory Clustering and Hidden-Unit BERT
In spite of the progress in music source separation research, the small ...
research
∙
03/07/2023
TS-SEP: Joint Diarization and Separation Conditioned on Estimated Speaker Embeddings
Since diarization and source separation of meeting data are closely rela...
research
∙
12/14/2022
Tackling the Cocktail Fork Problem for Separation and Transcription of Real-World Soundtracks
Emulating the human ability to solve the cocktail party problem, i.e., f...
research
∙
12/09/2022
Hyperbolic Audio Source Separation
We introduce a framework for audio source separation using embeddings on...
research
∙
11/22/2022
Latent Iterative Refinement for Modular Source Separation
Traditional source separation approaches train deep neural network model...
research
∙
11/15/2022
Reverberation as Supervision for Speech Separation
This paper proposes reverberation as supervision (RAS), a novel unsuperv...
research
∙
11/11/2022
Optimal Condition Training for Target Source Separation
Recent research has shown remarkable performance in leveraging multiple ...
research
∙
11/04/2022
Cold Diffusion for Speech Enhancement
Diffusion models have recently shown promising results for difficult enh...
research
∙
11/02/2022
Towards End-to-end Speaker Diarization in the Wild
Speaker diarization algorithms address the "who spoke when" problem in a...
research
∙
04/21/2022
STFT-Domain Neural Speech Enhancement with Very Low Algorithmic Latency
Deep learning based speech enhancement in the short-term Fourier transfo...
research
∙
04/07/2022
Heterogeneous Target Speech Separation
We introduce a new paradigm for single-channel target source separation ...
research
∙
03/08/2022
Locate This, Not That: Class-Conditioned Sound Event DOA Estimation
Existing systems for sound event localization and detection (SELD) typic...
research
∙
03/01/2022
Extended Graph Temporal Classification for Multi-Speaker End-to-End ASR
Graph-based temporal classification (GTC), a generalized form of the con...
research
∙
02/18/2022
(2.5+1)D Spatio-Temporal Scene Graphs for Video Question Answering
Spatio-temporal scene-graph approaches to video-based reasoning tasks su...
research
∙
11/01/2021
Sequence Transduction with Graph-based Supervision
The recurrent neural network transducer (RNN-T) objective plays a major ...
research
∙
10/19/2021
The Cocktail Fork Problem: Three-Stem Audio Separation for Real-World Soundtracks
The cocktail party problem aims at isolating any source of interest with...
research
∙
10/13/2021
Audio-Visual Scene-Aware Dialog and Reasoning using Audio-Visual Transformers with Joint Student-Teacher Learning
In previous work, we have proposed the Audio-Visual Scene-Aware Dialog (...
research
∙
10/11/2021
Advancing Momentum Pseudo-Labeling with Conformer and Initialization Strategy
Pseudo-labeling (PL), a semi-supervised learning (SSL) method where a se...
research
∙
10/01/2021
Leveraging Low-Distortion Target Estimates for Improved Speech Enhancement
A promising approach for multi-microphone speech separation involves two...
research
∙
09/24/2021
Visual Scene Graphs for Audio Source Separation
State-of-the-art approaches for visually-guided audio source separation ...
research
∙
08/16/2021
Convolutive Prediction for Monaural Speech Dereverberation and Noisy-Reverberant Speaker Separation
A promising approach for speech dereverberation is based on supervised l...
research
∙
08/16/2021
Convolutive Prediction for Reverberant Speech Separation
We investigate the effectiveness of convolutive prediction, a novel form...
research
∙
08/11/2021
On The Compensation Between Magnitude and Phase in Speech Separation
Deep neural network (DNN) based end-to-end optimization in the complex t...
research
∙
08/04/2021
Optimizing Latency for Online Video CaptioningUsing Audio-Visual Transformers
Video captioning is an essential technology to understand scenes and des...
research
∙
07/02/2021
Dual Causal/Non-Causal Self-Attention for Streaming End-to-End Speech Recognition
Attention-based end-to-end automatic speech recognition (ASR) systems ha...
research
∙
06/16/2021
Momentum Pseudo-Labeling for Semi-Supervised Speech Recognition
Pseudo-labeling (PL) has been shown to be effective in semi-supervised a...
research
∙
04/19/2021
Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers
This paper addresses end-to-end automatic speech recognition (ASR) for l...
research
∙
04/07/2021
Capturing Multi-Resolution Context by Dilated Self-Attention
Self-attention has become an important and widely used neural network co...
research
∙
11/26/2020
Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training
The performance of automatic speech recognition (ASR) systems typically ...
research
∙
10/29/2020
Semi-Supervised Speech Recognition via Graph-based Temporal Classification
Semi-supervised learning has demonstrated promising results in automatic...
research
∙
10/22/2020
Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision
Most music source separation systems require large collections of isolat...
research
∙
09/23/2020
Multi-Pass Transformer for Machine Translation
In contrast with previous approaches where information flows only toward...
research
∙
07/25/2020
AutoClip: Adaptive Gradient Clipping for Source Separation Networks
Clipping the gradient is a known approach to improving gradient descent,...
research
∙
07/08/2020
Spatio-Temporal Scene Graphs for Video Dialog
The Audio-Visual Scene-aware Dialog (AVSD) task requires an agent to ind...
research
∙
06/02/2020
Detecting Audio Attacks on ASR Systems with Dropout Uncertainty
Various adversarial audio attacks have recently been developed to fool a...
research
∙
02/14/2020
Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR
We propose an unsupervised speaker adaptation method inspired by the neu...
research
∙
02/10/2020
End-to-End Multi-speaker Speech Recognition with Transformer
Recently, fully recurrent neural network (RNN) based end-to-end models h...
research
∙
01/08/2020
Streaming automatic speech recognition with the transformer model
Encoder-decoder based sequence-to-sequence models have demonstrated stat...
research
∙
11/06/2019
Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision
While there has been much recent progress using deep learning techniques...
research
∙
10/23/2019
Bootstrapping deep music separation from primitive auditory grouping principles
Separating an audio scene such as a cocktail party into constituent, mea...
research
∙
10/22/2019
WHAMR!: Noisy and Reverberant Single-Channel Speech Separation
While significant advances have been made in recent years in the separat...
research
∙
10/15/2019
MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition
Recently, the end-to-end approach has proven its efficacy in monaural mu...
research
∙
09/18/2019
Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity
Music source separation performance has greatly improved in recent years...
research
∙
07/02/2019
WHAM!: Extending Speech Separation to Noisy Environments
Recent progress in separating the speech signals from multiple overlappi...
research
∙
05/08/2019
Universal Sound Separation
Recent deep learning approaches have achieved impressive performance on ...
research
∙
11/07/2018
Class-conditional embeddings for music source separation
Isolating individual instruments in a musical mixture has a myriad of po...
research
∙
11/06/2018
SDR - half-baked or well done?
In speech enhancement and source separation, signal-to-noise ratio is a ...
research
∙
11/06/2018