Shinji Watanabe

A Study on Speech Enhancement Based on Diffusion Probabilistic Model

Diffusion probabilistic models have demonstrated an outstanding capabili...
07/25/2021 ∙ by Yen-Ju Lu, et al. ∙ 0 ∙ share

read it
Differentiable Allophone Graphs for Language-Universal Speech Recognition

Building language-universal speech recognition systems entails producing...
07/24/2021 ∙ by Brian Yan, et al. ∙ 0 ∙ share

read it
On Prosody Modeling for ASR+TTS based Voice Conversion

In voice conversion (VC), an approach showing promising results in the l...
07/20/2021 ∙ by Wen-Chin Huang, et al. ∙ 0 ∙ share

read it
Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models

Non-autoregressive (NAR) modeling has gained more and more attention in ...
07/20/2021 ∙ by Tianzi Wang, et al. ∙ 0 ∙ share

read it
Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021

We present a system for the Zero Resource Speech Challenge 2021, which c...
07/13/2021 ∙ by Takashi Maekaku, et al. ∙ 0 ∙ share

read it
Towards Neural Diarization for Unlimited Numbers of Speakers Using Global and Local Attractors

Attractor-based end-to-end diarization is achieving comparable accuracy ...
07/04/2021 ∙ by Shota Horiguchi, et al. ∙ 0 ∙ share

read it
ESPnet-ST IWSLT 2021 Offline Speech Translation System

This paper describes the ESPnet-ST group's IWSLT 2021 submission in the ...
07/01/2021 ∙ by Hirofumi Inaguma, et al. ∙ 0 ∙ share

read it
Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding

Decomposable tasks are complex and comprise of a hierarchy of sub-tasks....
06/29/2021 ∙ by Siddhant Arora, et al. ∙ 0 ∙ share

read it
Encoder-Decoder Based Attractor Calculation for End-to-End Neural Diarization

This paper investigates an end-to-end neural diarization (EEND) method f...
06/20/2021 ∙ by Shota Horiguchi, et al. ∙ 0 ∙ share

read it
Multi-mode Transformer Transducer with Stochastic Future Context

Automatic speech recognition (ASR) models make fewer errors when more su...
06/17/2021 ∙ by Kwangyoun Kim, et al. ∙ 0 ∙ share

read it
Layer Pruning on Demand with Intermediate CTC

Deploying an end-to-end automatic speech recognition (ASR) model on mobi...
06/17/2021 ∙ by Jaesong Lee, et al. ∙ 0 ∙ share

read it
Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain

Non-autoregressive (NAR) models have achieved a large inference computat...
06/16/2021 ∙ by Pengcheng Guo, et al. ∙ 0 ∙ share

read it
GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio

This paper introduces GigaSpeech, an evolving, multi-domain English spee...
06/13/2021 ∙ by Guoguo Chen, et al. ∙ 0 ∙ share

read it
Leveraging Pre-trained Language Model for Speech Sentiment Analysis

In this paper, we explore the use of pre-trained language models to lear...
06/11/2021 ∙ by Suwon Shon, et al. ∙ 0 ∙ share

read it
Semi-Supervised Training with Pseudo-Labeling for End-to-End Neural Diarization

In this paper, we present a semi-supervised training technique using pse...
06/09/2021 ∙ by Yuki Takashima, et al. ∙ 0 ∙ share

read it
End-to-End Speaker Diarization Conditioned on Speech Activity and Overlap Detection

In this paper, we present a conditional multitask learning method for en...
06/08/2021 ∙ by Yuki Takashima, et al. ∙ 0 ∙ share

read it
Data Augmentation Methods for End-to-end Speech Recognition on Distant-Talk Scenarios

Although end-to-end automatic speech recognition (E2E ASR) has achieved ...
06/07/2021 ∙ by Emiru Tsunoo, et al. ∙ 0 ∙ share

read it
Self-Guided Curriculum Learning for Neural Machine Translation

In the field of machine learning, the well-trained model is assumed to b...
05/10/2021 ∙ by Lei Zhou, et al. ∙ 0 ∙ share

read it
End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings

We present an end-to-end deep network model that performs meeting diariz...
05/05/2021 ∙ by Soumi Maiti, et al. ∙ 0 ∙ share

read it
SUPERB: Speech processing Universal PERformance Benchmark

Self-supervised learning (SSL) has proven vital for advancing research i...
05/03/2021 ∙ by Shu-wen Yang, et al. ∙ 0 ∙ share

read it
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks

End-to-end approaches for sequence tasks are becoming increasingly popul...
05/02/2021 ∙ by Siddharth Dalmia, et al. ∙ 7 ∙ share

read it
EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition

Self-supervised ASR-TTS models suffer in out-of-domain data conditions. ...
04/13/2021 ∙ by Murali Karthick Baskar, et al. ∙ 0 ∙ share

read it
Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation

A conventional approach to improving the performance of end-to-end speec...
04/13/2021 ∙ by Hirofumi Inaguma, et al. ∙ 0 ∙ share

read it
SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition

In the English speech-to-text (STT) machine learning task, acoustic mode...
04/05/2021 ∙ by Patrick K. O'Neill, et al. ∙ 14 ∙ share

read it
INTERSPEECH 2021 ConferencingSpeech Challenge: Towards Far-field Multi-Channel Speech Enhancement for Video Conferencing

The ConferencingSpeech 2021 challenge is proposed to stimulate research ...
04/02/2021 ∙ by Wei Rao, et al. ∙ 0 ∙ share

read it
Dual-Path Modeling for Long Recording Speech Separation in Meetings

The continuous speech separation (CSS) is a task to separate the speech ...
02/23/2021 ∙ by Chenda Li, et al. ∙ 0 ∙ share

read it
End-to-End Dereverberation, Beamforming, and Speech Recognition with Improved Numerical Stability and Advanced Frontend

Recently, the end-to-end approach has been successfully applied to multi...
02/23/2021 ∙ by Wangyou Zhang, et al. ∙ 0 ∙ share

read it
Gaussian Kernelized Self-Attention for Long Sequence Data and Its Application to CTC-based Speech Recognition

Self-attention (SA) based models have recently achieved significant perf...
02/18/2021 ∙ by Yosuke Kashiwagi, et al. ∙ 0 ∙ share

read it
Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition

Multi-source localization is an important and challenging technique for ...
02/16/2021 ∙ by Aswin Shanmugam Subramanian, et al. ∙ 0 ∙ share

read it
Intermediate Loss Regularization for CTC-based Speech Recognition

We present a simple and efficient auxiliary loss function for automatic ...
02/05/2021 ∙ by Jaesong Lee, et al. ∙ 0 ∙ share

read it
The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap

This paper provides a detailed description of the Hitachi-JHU system tha...
02/02/2021 ∙ by Shota Horiguchi, et al. ∙ 15 ∙ share

read it
Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yoloxóchitl Mixtec

"Transcription bottlenecks", created by a shortage of effective human tr...
01/26/2021 ∙ by Jiatong Shi, et al. ∙ 0 ∙ share

read it
A Review of Speaker Diarization: Recent Advances with Deep Learning

Speaker diarization is a task to label audio or video recordings with cl...
01/24/2021 ∙ by Tae Jin Park, et al. ∙ 3 ∙ share

read it
Online End-to-End Neural Diarization Handling Overlapping Speech and Flexible Numbers of Speakers

This paper proposes an online end-to-end diarization that can handle ove...
01/21/2021 ∙ by Yawen Xue, et al. ∙ 0 ∙ share

read it
Arabic Speech Recognition by End-to-End, Modular Systems and Human

Recent advances in automatic speech recognition (ASR) have achieved accu...
01/21/2021 ∙ by Amir Hussein, et al. ∙ 27 ∙ share

read it
The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans

This paper describes the recent development of ESPnet (https://github.co...
12/23/2020 ∙ by Shinji Watanabe, et al. ∙ 0 ∙ share

read it
End-to-End Speaker Diarization as Post-Processing

This paper investigates the utilization of an end-to-end diarization mod...
12/18/2020 ∙ by Shota Horiguchi, et al. ∙ 0 ∙ share

read it
Continuous Speech Separation Using Speaker Inventory for Long Multi-talker Recording

Leveraging additional speaker information to facilitate speech separatio...
12/17/2020 ∙ by Cong Han, et al. ∙ 0 ∙ share

read it
Improving RNN Transducer With Target Speaker Extraction and Neural Uncertainty Estimation

Target-speaker speech recognition aims to recognize target-speaker speec...
11/26/2020 ∙ by Jiatong Shi, et al. ∙ 0 ∙ share

read it
ESPnet-se: end-to-end speech enhancement and separation toolkit designed for asr integration

We present ESPnet-SE, which is designed for the quick development of spe...
11/07/2020 ∙ by Chenda Li, et al. ∙ 0 ∙ share

read it
Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis

Multi-speaker speech recognition of unsegmented recordings has diverse a...
11/03/2020 ∙ by Desh Raj, et al. ∙ 0 ∙ share

read it
DOVER-Lap: A Method for Combining Overlap-aware Diarization Outputs

Several advances have been made recently towards handling overlapping sp...
11/03/2020 ∙ by Desh Raj, et al. ∙ 0 ∙ share

read it
Directional ASR: A New Paradigm for E2E Multi-Speaker Speech Recognition with Source Localization

This paper proposes a new paradigm for handling far-field multi-speaker ...
10/30/2020 ∙ by Aswin Shanmugam Subramanian, et al. ∙ 0 ∙ share

read it
Recent Developments on ESPnet Toolkit Boosted by Conformer

In this study, we present recent developments on ESPnet: End-to-End Spee...
10/26/2020 ∙ by Pengcheng Guo, et al. ∙ 0 ∙ share

read it
Improved Mask-CTC for Non-Autoregressive End-to-End ASR

For real-world deployment of automatic speech recognition (ASR), the sys...
10/26/2020 ∙ by Yosuke Higuchi, et al. ∙ 0 ∙ share

read it
Orthros: Non-autoregressive End-to-end Speech Translation with Dual-decoder

Fast inference speed is an important goal towards real-world deployment ...
10/25/2020 ∙ by Hirofumi Inaguma, et al. ∙ 0 ∙ share

read it
Training Noisy Single-Channel Speech Separation With Noisy Oracle Sources: A Large Gap and A Small Step

As the performance of single-channel speech separation systems has impro...
10/23/2020 ∙ by Matthew Maciejewski, et al. ∙ 0 ∙ share

read it
Learning Speaker Embedding from Text-to-Speech

Zero-shot multi-speaker Text-to-Speech (TTS) generates target speaker vo...
10/21/2020 ∙ by Jaejin Cho, et al. ∙ 0 ∙ share

read it
The Sequence-to-Sequence Baseline for the Voice Conversion Challenge 2020: Cascading ASR and TTS

This paper presents the sequence-to-sequence (seq2seq) baseline system f...
10/06/2020 ∙ by Wen-Chin Huang, et al. ∙ 0 ∙ share

read it
Augmentation adversarial training for unsupervised speaker recognition

The goal of this work is to train robust speaker recognition models with...
07/23/2020 ∙ by Jaesung Huh, et al. ∙ 0 ∙ share

read it

Shinji Watanabe

Featured Co-authors