research
∙
06/23/2023
The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios
The CHiME challenges have played a significant role in the development a...
share
research
∙
06/20/2023
HK-LegiCoST: Leveraging Non-Verbatim Transcripts for Speech Translation
We introduce HK-LegiCoST, a new three-way parallel corpus of Cantonese-E...
research
∙
06/18/2023
SURT 2.0: Advances in Transducer-based Multi-talker Speech Recognition
The Streaming Unmixing and Recognition Transducer (SURT) model was propo...
research
∙
06/01/2023
Bypass Temporal Classification: Weakly Supervised Automatic Speech Recognition with Imperfect Transcripts
This paper presents a novel algorithm for building an automatic speech r...
research
∙
05/30/2023
Investigating model performance in language identification: beyond simple error statistics
Language development experts need tools that can automatically identify ...
research
∙
12/10/2022
GPU-accelerated Guided Source Separation for Meeting Transcription
Guided source separation (GSS) is a type of target-speaker extraction me...
research
∙
11/30/2022
EURO: ESPnet Unsupervised ASR Open-source Toolkit
This paper describes the ESPnet Unsupervised ASR Open-source Toolkit (EU...
research
∙
11/01/2022
Adapting self-supervised models to multi-talker speech recognition using speaker embeddings
Self-supervised learning (SSL) methods which learn representations of da...
research
∙
10/26/2022
Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarization
Code-switching (CS) refers to the phenomenon that languages switch withi...
research
∙
04/08/2022
Defense against Adversarial Attacks on Hybrid Speech Recognition using Joint Adversarial Fine-tuning with Denoiser
Adversarial attacks are a threat to automatic speech recognition (ASR) s...
research
∙
03/07/2022
Enhance Language Identification using Dual-mode Model with Knowledge Distillation
In this paper, we propose to employ a dual-mode framework on the x-vecto...
research
∙
10/25/2021
Lhotse: a speech data representation library for the modern deep learning ecosystem
Speech data is notoriously difficult to work with due to a variety of co...
research
∙
10/10/2021
Injecting Text and Cross-lingual Supervision in Few-shot Learning from Self-Supervised Models
Self-supervised model pre-training has recently garnered significant int...
research
∙
06/13/2021
GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio
This paper introduces GigaSpeech, an evolving, multi-domain English spee...
research
∙
04/05/2021
Reformulating DOVER-Lap Label Mapping as a Graph Partitioning Problem
We recently proposed DOVER-Lap, a method for combining overlap-aware spe...
research
∙
03/31/2021
Adversarial Attacks and Defenses for Speech Recognition Systems
The ubiquitous presence of machine learning systems in our lives necessi...
research
∙
03/16/2021
An Asynchronous WFST-Based Decoder For Automatic Speech Recognition
We introduce asynchronous dynamic decoder, which adopts an efficient A* ...
research
∙
03/11/2021
Learning Feature Weights using Reward Modeling for Denoising Parallel Corpora
Large web-crawled corpora represent an excellent resource for improving ...
research
∙
03/11/2021
Learning Policies for Multilingual Training of Neural Machine Translation Systems
Low-resource Multilingual Neural Machine Translation (MNMT) is typically...
research
∙
03/08/2021
A Parallelizable Lattice Rescoring Strategy with Neural Language Models
This paper proposes a parallel computation strategy and a posterior-base...
research
∙
02/02/2021
The Hitachi-JHU DIHARD III System: Competitive End-to-End Neural Diarization and X-Vector Clustering Systems Combined by DOVER-Lap
This paper provides a detailed description of the Hitachi-JHU system tha...
research
∙
12/02/2020
Fine-grained activity recognition for assembly videos
In this paper we address the task of recognizing assembly actions as a s...
research
∙
11/05/2020
Multi-class Spectral Clustering with Overlaps for Speaker Diarization
This paper describes a method for overlap-aware speaker diarization. Giv...
research
∙
11/04/2020
Frustratingly Easy Noise-aware Training of Acoustic Models
Environmental noises and reverberation have a detrimental effect on the ...
research
∙
11/03/2020
DOVER-Lap: A Method for Combining Overlap-aware Diarization Outputs
Several advances have been made recently towards handling overlapping sp...
research
∙
10/23/2020
Training Noisy Single-Channel Speech Separation With Noisy Oracle Sources: A Large Gap and A Small Step
As the performance of single-channel speech separation systems has impro...
research
∙
08/05/2020
Efficient MDI Adaptation for n-gram Language Models
This paper presents an efficient algorithm for n-gram language model ada...
research
∙
06/14/2020
The JHU Multi-Microphone Multi-Speaker ASR System for the CHiME-6 Challenge
This paper summarizes the JHU team's efforts in tracks 1 and 2 of the CH...
research
∙
05/20/2020
PyChain: A Fully Parallelized PyTorch Implementation of LF-MMI for End-to-End ASR
We present PyChain, a fully parallelized PyTorch implementation of end-t...
research
∙
05/17/2020
Wake Word Detection with Alignment-Free Lattice-Free MMI
Always-on spoken language interfaces, e.g. personal digital assistants, ...
research
∙
02/14/2020
Speaker Diarization with Region Proposal Network
Speaker diarization is an important pre-processing step for many speech ...
research
∙
09/18/2019
Espresso: A Fast End-to-end Neural Speech Recognition Toolkit
We present Espresso, an open-source, modular, extensible end-to-end neur...
research
∙
09/13/2019
Probing the Information Encoded in x-vectors
Deep neural network based speaker embeddings, such as x-vectors, have be...
research
∙
12/10/2018
Low Resource Multi-modal Data Augmentation for End-to-end ASR
We explore training attention-based encoder-decoder ASR for low-resource...
research
∙
11/06/2018
Building Corpora for Single-Channel Speech Separation Across Multiple Domains
To date, the bulk of research on single-channel speech separation has be...
research
∙
07/17/2018
Low-Resource Contextual Topic Identification on Speech
In topic identification (topic ID) on real-world unstructured audio, an ...
research
∙
04/09/2018
A GPU-based WFST Decoder with Exact Lattice Generation
We describe initial work on an extension of the Kaldi toolkit that suppo...
research
∙
02/23/2018
The JHU Speech LOREHLT 2017 System: Cross-Language Transfer for Situation-Frame Detection
We describe the system our team used during NIST's LoReHLT (Low Resource...
research
∙
02/16/2018
Bayesian Models for Unit Discovery on a Very Low Resource Language
Developing speech technologies for low-resource languages has become a v...
research
∙
06/12/2017
Acoustic data-driven lexicon learning based on a greedy pronunciation selection framework
Speech recognition systems for irregularly-spelled languages like Englis...
research
∙
06/01/2017
Using of heterogeneous corpora for training of an ASR system
The paper summarizes the development of the LVCSR system built as a part...
research
∙
03/22/2017
Topic Identification for Speech without ASR
Modern topic identification (topic ID) systems for speech use automatic ...
research
∙
02/05/2017
An Empirical Evaluation of Zero Resource Acoustic Unit Discovery
Acoustic unit discovery (AUD) is a process of automatically identifying ...
research
∙
10/30/2015
Highway Long Short-Term Memory RNNs for Distant Speech Recognition
In this paper, we extend the deep long short-term memory (DLSTM) recurre...
research
∙
10/27/2014