research
∙
09/18/2023
Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech
Text language models have shown remarkable zero-shot capability in gener...
share
research
∙
04/25/2023
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
Large language models (LLMs) have exhibited remarkable capabilities acro...
research
∙
04/10/2023
Enhancing Speech-to-Speech Translation with Multiple TTS Targets
It has been known that direct speech-to-speech translation (S2ST) models...
research
∙
03/14/2023
I3D: Transformer architectures with input-dependent dynamic depth for speech recognition
Transformer-based end-to-end speech recognition has achieved great succe...
research
∙
03/03/2023
End-to-End Speech Recognition: A Survey
In the last decade of automatic speech recognition (ASR) research, the i...
research
∙
02/16/2023
TAPLoss: A Temporal Acoustic Parameter Loss for Speech Enhancement
Speech enhancement models have greatly progressed in recent years, but s...
research
∙
12/15/2022
UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units
Direct speech-to-speech translation (S2ST), in which all components can ...
research
∙
12/08/2022
SpeechLMScore: Evaluating speech generation using speech language model
While human evaluation is the most reliable metric for evaluating speech...
research
∙
09/30/2022
E-Branchformer: Branchformer with Enhanced merging for speech recognition
Conformer, combining convolution and self-attention sequentially to capt...
research
∙
09/13/2022
Deep Speech Synthesis from Articulatory Representations
In the articulatory synthesis task, speech is synthesized from input fea...
research
∙
09/08/2022
TF-GridNet: Making Time-Frequency Domain Models Great Again for Monaural Speaker Separation
We propose TF-GridNet, a novel multi-path deep neural network (DNN) oper...
research
∙
04/21/2022
STFT-Domain Neural Speech Enhancement with Very Low Algorithmic Latency
Deep learning based speech enhancement in the short-term Fourier transfo...
research
∙
03/31/2022
EEND-SS: Joint End-to-End Neural Speaker Diarization and Speech Separation for Flexible Number of Speakers
In this paper, we present a novel framework that jointly performs speake...
research
∙
03/14/2022
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities
Transfer learning has proven to be crucial in advancing the state of spe...
research
∙
12/17/2021
JTubeSpeech: corpus of Japanese speech collected from YouTube for speech recognition and speaker verification
In this paper, we construct a new Japanese speech corpus called "JTubeSp...
research
∙
10/15/2021
ESPnet2-TTS: Extending the Edge of TTS Research
This paper describes ESPnet2-TTS, an end-to-end text-to-speech (E2E-TTS)...
research
∙
10/11/2021
SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition
The Transformer architecture has been well adopted as a dominant archite...
research
∙
06/11/2021
Leveraging Pre-trained Language Model for Speech Sentiment Analysis
In this paper, we explore the use of pre-trained language models to lear...
research
∙
10/25/2020
Orthros: Non-autoregressive End-to-end Speech Translation with Dual-decoder
Fast inference speed is an important goal towards real-world deployment ...
research
∙
06/25/2020
Streaming Transformer ASR with Blockwise Synchronous Inference
The Transformer self-attention network has recently shown promising perf...
research
∙
05/20/2020
End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractors
End-to-end speaker diarization for an unknown number of speakers is addr...
research
∙
10/16/2019
Transformer ASR with Contextual Block Processing
The Transformer self-attention network has recently shown promising perf...
research
∙
09/13/2019
A Comparative Study on Transformer vs RNN in Speech Applications
Sequence-to-sequence models have been widely used in end-to-end speech p...
research
∙
12/10/2018
Low Resource Multi-modal Data Augmentation for End-to-end ASR
We explore training attention-based encoder-decoder ASR for low-resource...
research
∙
03/30/2018
ESPnet: End-to-End Speech Processing Toolkit
This paper introduces a new open source platform for end-to-end speech p...
research
∙
07/07/2016
