research
∙
09/15/2023
Augmenting conformers with structured state space models for online speech recognition
Online speech recognition, where the model only accesses context to the ...
share
research
∙
09/15/2023
Towards Word-Level End-to-End Neural Speaker Diarization with Auxiliary Network
While standard speaker diarization attempts to answer the question "who ...
research
∙
03/31/2023
Practical Conformer: Optimizing size, speed and flops of Conformer for on-Device and cloud ASR
Conformer models maintain a large number of internal states, the vast ma...
research
∙
02/16/2023
JEIT: Joint End-to-End Model and Internal Language Model Training for Speech Recognition
We propose JEIT, a joint end-to-end (E2E) model and internal language mo...
research
∙
10/13/2022
JOIST: A Joint Speech and Text Streaming Model For ASR
We present JOIST, an algorithm to train a streaming, cascaded, encoder e...
research
∙
06/29/2022
Improving Deliberation by Text-Only and Semi-Supervised Training
Text-only and semi-supervised training based on audio-only data has gain...
research
∙
04/15/2022
Streaming Align-Refine for Non-autoregressive Deliberation
We propose a streaming non-autoregressive (non-AR) decoding algorithm to...
research
∙
04/15/2022
Improving Rare Word Recognition with LM-aware MWER Training
Language models (LMs) significantly improve the recognition accuracy of ...
research
∙
04/13/2022
A Unified Cascaded Encoder ASR Model for Dynamic Model Sizes
In this paper, we propose a dynamic cascaded encoder Automatic Speech Re...
research
∙
10/22/2021
Contrastively Disentangled Sequential Variational Autoencoder
Self-supervised disentangled representation learning is a critical task ...
research
∙
06/14/2021
Latent Correlation-Based Multiview Learning and Self-Supervision: A Unifying Perspective
Multiple views of data, both naturally acquired (e.g., image and audio) ...
research
∙
10/07/2020
Representation Learning for Sequence Data with Deep Autoencoding Predictive Components
We propose Deep Autoencoding Predictive Components (DAPC) – a self-super...
research
∙
02/14/2020
A Comparison of Pooling Methods on LSTM Models for Rare Acoustic Event Classification
Acoustic event classification (AEC) and acoustic event detection (AED) r...
research
∙
01/28/2020
Unsupervised Pre-training of Bidirectional Speech Encoders via Masked Reconstruction
We propose an approach for pre-training speech representations via a mas...
research
∙
01/24/2020
Data Techniques For Online End-to-end Speech Recognition
Practitioners often need to build ASR systems for new use cases in a sho...
research
∙
01/24/2020
Semi-supervised ASR by End-to-end Self-training
While deep learning based end-to-end automatic speech recognition (ASR) ...
research
∙
09/16/2019
Acoustic scene analysis with multi-head attention networks
Acoustic Scene Classification (ASC) is a challenging task, as a single s...
research
∙
06/24/2019
Multimodal and Multi-view Models for Emotion Recognition
Studies on emotion recognition (ER) show that combining lexical and acou...
research
∙
03/08/2019
Everything old is new again: A multi-view learning approach to learning using privileged information and distillation
We adopt a multi-view approach for analyzing two knowledge transfer sett...
research
∙
08/20/2018
A simple model for detection of rare sound events
We propose a simple recurrent model for detecting rare sound events, whe...
research
∙
08/20/2018
R-CRNN: Region-based Convolutional Recurrent Neural Network for Audio Event Detection
This paper proposes a Region-based Convolutional Recurrent Neural Networ...
research
∙
03/19/2018
Acoustic feature learning using cross-domain articulatory measurements
Previous work has shown that it is possible to improve speech recognitio...
research
∙
03/19/2018
Acoustic feature learning cross-domain articulatory measurements
Previous work has shown that it is possible to improve speech recognitio...
research
∙
02/11/2018
Distributed Stochastic Multi-Task Learning with Graph Regularization
We propose methods for distributed graph-based multi-task learning that ...
research
∙
08/11/2017
Acoustic Feature Learning via Deep Variational Canonical Correlation Analysis
We study the problem of acoustic feature learning in the setting where w...
research
∙
02/25/2017
Efficient coordinate-wise leading eigenvector computation
We develop and analyze efficient "coordinate-wise" methods for finding t...
research
∙
02/21/2017
Stochastic Canonical Correlation Analysis
We tightly analyze the sample complexity of CCA, provide a learning algo...
research
∙
11/14/2016
Multi-view Recurrent Neural Acoustic Word Embeddings
Recent work has begun exploring neural acoustic word embeddings---fixed-...
research
∙
10/21/2016
End-to-End Training Approaches for Discriminative Segmental Models
Recent work on discriminative segmental models has shown that they can a...
research
∙
09/26/2016
Lexicon-Free Fingerspelling Recognition from Video: Data, Models, and Signer Adaptation
We study the problem of recognizing video sequences of fingerspelled let...
research
∙
08/02/2016
Efficient Segmental Cascades for Speech Recognition
Discriminative segmental models offer a way to incorporate flexible feat...
research
∙
02/13/2016
Signer-independent Fingerspelling Recognition with Deep Neural Network Adaptation
We study the problem of recognition of fingerspelled letter sequences in...
research
∙
02/07/2016
Network Inference by Learned Node-Specific Degree Prior
We propose a novel method for network inference from partially observed ...
research
∙
02/05/2016
On Column Selection in Approximate Kernel Canonical Correlation Analysis
We study the problem of column selection in large-scale kernel canonical...
research
∙
11/16/2015
Nonparametric Canonical Correlation Analysis
Canonical correlation analysis (CCA) is a classical representation learn...
research
∙
10/05/2015
Deep convolutional acoustic word embeddings using word-pair side information
Recent studies have been revisiting whole words as the basic modelling u...
research
∙
07/22/2015
Discriminative Segmental Cascades for Feature-Rich Phone Recognition
Discriminative segmental models, such as segmental conditional random fi...
research
∙
05/26/2014
The role of dimensionality reduction in linear classification
Dimensionality reduction (DR) is often used as a preprocessing step in c...
research
∙
05/23/2014
LASS: a simple assignment model with Laplacian smoothing
We consider the problem of learning soft assignments of N items to K cat...
research
∙
09/06/2013
Projection onto the probability simplex: An efficient algorithm with a simple proof, and an application
We provide an elementary proof of a simple, efficient algorithm for comp...
research
∙
04/24/2013
The K-modes algorithm for clustering
Many clustering algorithms exist that estimate a cluster centroid, such ...
research
∙
12/24/2012