research
∙
09/14/2023
Voxtlm: unified decoder-only models for consolidating speech recognition/synthesis and speech/text continuation tasks
We propose a decoder-only language model, VoxtLM, that can perform four ...
share
research
∙
08/21/2023
TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognition
We present TokenSplit, a speech separation model that acts on discrete t...
research
∙
07/23/2023
Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representation
Neural speech separation has made remarkable progress and its integratio...
research
∙
06/23/2023
The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios
The CHiME challenges have played a significant role in the development a...
research
∙
06/11/2023
Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute
Self-supervised learning (SSL) has led to great strides in speech proces...
research
∙
05/29/2023
Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning
Self-supervised learning (SSL) of speech has shown impressive results in...
research
∙
05/18/2023
ML-SUPERB: Multilingual Speech Universal PERformance Benchmark
Speech processing Universal PERformance Benchmark (SUPERB) is a leaderbo...
research
∙
04/25/2023
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
Large language models (LLMs) have exhibited remarkable capabilities acro...
research
∙
11/10/2022
A Study on the Integration of Pre-trained SSL, ASR, LM and SLU Models for Spoken Language Understanding
Collecting sufficient labeled data for spoken language understanding (SL...
research
∙
10/19/2022
End-to-End Integration of Speech Recognition, Dereverberation, Beamforming, and Self-Supervised Learning Representation
Self-supervised learning representation (SSLR) has demonstrated its sign...
research
∙
10/16/2022
SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning
We present the SUPERB challenge at SLT 2022, which aims at learning self...
research
∙
07/19/2022
ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding
This paper presents recent progress on integrating speech separation and...
research
∙
07/14/2022
Two-Pass Low Latency End-to-End Spoken Language Understanding
End-to-end (E2E) models are becoming increasingly popular for spoken lan...
research
∙
04/01/2022
End-to-End Integration of Speech Recognition, Speech Enhancement, and Self-Supervised Learning Representation
This work presents our end-to-end (E2E) automatic speech recognition (AS...
research
∙
04/01/2022
End-to-End Multi-speaker ASR with Independent Vector Analysis
We develop an end-to-end system for multi-channel, multi-speaker automat...
research
∙
03/14/2022
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities
Transfer learning has proven to be crucial in advancing the state of spe...
research
∙
03/01/2022
Extended Graph Temporal Classification for Multi-Speaker End-to-End ASR
Graph-based temporal classification (GTC), a generalized form of the con...
research
∙
02/24/2022
Towards Low-distortion Multi-channel Speech Enhancement: The ESPNet-SE Submission to The L3DAS22 Challenge
This paper describes our submission to the L3DAS22 Challenge Task 1, whi...
research
∙
02/03/2022
Joint Speech Recognition and Audio Captioning
Speech samples recorded in both indoor and outdoor environments are ofte...
research
∙
12/17/2021
Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem
Deep learning based models have significantly improved the performance o...
research
∙
11/29/2021
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet
As Automatic Speech Processing (ASR) systems are getting better, there i...
research
∙
10/09/2021
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition
Self-supervised pretraining on speech data has achieved a lot of progres...
research
∙
07/20/2021
Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models
Non-autoregressive (NAR) modeling has gained more and more attention in ...
research
∙
07/13/2021
Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021
We present a system for the Zero Resource Speech Challenge 2021, which c...
research
∙
06/16/2021
Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain
Non-autoregressive (NAR) models have achieved a large inference computat...
research
∙
05/03/2021
SUPERB: Speech processing Universal PERformance Benchmark
Self-supervised learning (SSL) has proven vital for advancing research i...
research
∙
01/06/2021
Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
An end-to-end (E2E) speaker-attributed automatic speech recognition (SA-...
research
∙
12/23/2020
The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans
This paper describes the recent development of ESPnet (https://github.co...
research
∙
11/07/2020
ESPnet-se: end-to-end speech enhancement and separation toolkit designed for asr integration
We present ESPnet-SE, which is designed for the quick development of spe...
research
∙
10/26/2020
Recent Developments on ESPnet Toolkit Boosted by Conformer
In this study, we present recent developments on ESPnet: End-to-End Spee...
research
∙
08/11/2020
Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
Recently, an end-to-end (E2E) speaker-attributed automatic speech recogn...
research
∙
06/25/2020
Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals
Neural sequence-to-sequence models are well established for applications...
research
∙
05/21/2020
End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamforming
Despite successful applications of end-to-end approaches in multi-channe...
research
∙
02/10/2020
End-to-End Multi-speaker Speech Recognition with Transformer
Recently, fully recurrent neural network (RNN) based end-to-end models h...
research
∙
10/15/2019
MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition
Recently, the end-to-end approach has proven its efficacy in monaural mu...
research
∙
11/05/2018
End-to-End Monaural Multi-speaker ASR System without Pretraining
Recently, end-to-end models have become a popular approach as an alterna...
research
∙
07/19/2017